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ABSTRACT 

The purpose of this research effort is to validate 
the utility and effectiveness of a unique human performance 
measurement technique developed under ONR contract (NOOO 1U67C0107) • 
Performance data on eight Navy ratings was collected from ships of 
LANTFLT and PACFLT. This report is the last in a series of technical 
reports on the statistical analysis of that data- A statistical 
analysis is provided on performance related data for electronic 
maintenance personnel sampled from 21 ships. Four different 
performance estimators, as functions of critical incidents, were 
evaluated. A detailed explanation of the distributional properties of 
the performance estimators is presented, and an explanation of the 
factors that lead to the adoption of a curvilinear regression 
analysis for analysis of the data is discussed. The results of the 
statistical analysis indicated that a certain combination of the 
performance data possessed moderate validity for appraising the 
absolute level of technician on-the-job performance on the EM, ET, 
FT, and IC ratings. Application of the technique to technicians in 
the RM, ST, and TM ratings was tenuous, but still appropriate, while 
none of the performance estimators seemed to be applicable to 
technicians in the RD rating. For this reason, it would seem that the 
appropriateness of application of this technique to other ratings 
warrants investigation, perhaps by the approach employed in this 
report. In any event it has been observed that the technique 
possesses sufficient merit to be recommended for more widespread use 
within the U. S. Navy, (Author) 
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SUMMARY AND CONCLUSIONS 



Problem 

The advent of a mort streamlined ^^avy operating under reduced manning levels and 
heightened operational requirements imposes the need for accurate human-performance 
evaluation of ship personnel systems. On the personnel systems level, electronic 
technician reliability measurement is a necessary and integral part in the evaluation 
of particular combat systems which technicians are components. The objective is 
then to develop and evaluate hUiiian-performance reliability estimates so as to be able 
to effectively alter the personrel system in order to ma;<imi2e the overall performance 
of the system. The purpose of this project is to validate the utility and effectiveness 
of a unique humar performance measurement procedure developed under a prior Office of 
Naval Research project and designed to improve upon tjxisting perfonnance measuring 
techniques in a systems environment. 

Background and Req^uirements 

Human reliability performance estimation can be accomplished by considering the 
individuals being evaluated as components of a personnel system. This consideration 
allows the use of much of the theory already applied to equipment reliability estimation 
to be modified to human-performance estimation. After this theory is applied to evalu- 
ate the performance of human components in a personnel system, appropriate combinations 
of the individual performance estimators will provide a performance or reliability es- 
timate of the personnel system itself » 

In order to improve upon existing performance estimators of the human component in 
a personnel system. Dr. Arthur I. Siegel and his associates of Applied Psychological 
Services, Inc., Wayne, Pennsylvania, developed fleet post-training performance criteria 
for electronic maintenance personnel with the support of the Office of Naval Research. 
The cumulation of these efforts resulted in the development of unique human performance 
measurement techniques, closely allied with equipment rel'iability estimation techniques. 
Siegel also developed procedures for combining the technician performance estimates in 
appropriate ways in order to estimate team, ship or sqi'adron performance. 

An outgrowth of the prior research effort was the suggestion that the techniques 
be introduced on a limiteid basis to determine how they may be modified or elaborated 
upon. The Naval Personnel Research and Development Laboratory has been validating the 
utility and effectiveness of these techniques. The main technical objectives of this 
validation effort are to determine the validity of the performance measurement techniques, 
identify modifications required to maximize their possibil ity for implementation and to 
comment on the statistical properties of those techniques as related to their effective- 
ness in an operational context. 

Approach 

In order to realize an efficient and timely data collection effort, optical scanning 
instruments were utilized similar to those employed by Applied Psychological Services in 
prior research efforts. 

The main data collection instruments were: 

1. Job Performance Questionnaire (JPQ) ANSWER SHEET - this form records 
supervisory estimates of the total number of a technician's uncommonly 
effective (5^LIE) and uncommonly ineffective performance (eUI) that the 
supervisor has observed during a specified time period. 
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2. Technical Proficiency Checkout Form (TPCF) - this form records the level 
of technical complexity at v/hich a man is able to perform vnthout direct 
supervi sion. 

3. Personnel Identification Information Form (PI IF) - this form records 
demographic data on the technician being evaluated. 

On each of the above instruments an individual in one of the electronic maintenance 
ratings EM, ET, FT, IC, RD, RM, ST, and TM was evaluated by his supervisor. On the 
basis of the total number of uncommonly effective ("UE) and the total number of uncom- 
monly ineffective (ZUI) incidents of performance recorded on the Job Performance Ques- 
tionnaire (JPQ), three different performance estimators were developed previously by 
Applied Psychological Services. These estimators are functions of the total number of 
uncommonly effective (/:UE} and the total number of uncommonly ineffective (EUI) incidents 
of performance observed by the supervisor on each of eight job dimensions characteristic 
of electronic maintenance activities. The three estimators of human reliability are: 

1. Series Reliability Estimate (SRE) 

2. Series-Parallel Reliability Estimate (PRE) 

3. Geometric flean Reliability Estimate (GRE) 

In addition, a fourth measure of technician on-the-job performance developed in the 
course of th~s research effort was: 

4. Weighted-Average Reliability Estimate (WRE). 

By adopting the Technical Proficiency Checkout Form (TPCF) as a criterion measure 
of technician on-the-job performance, the degree of association between each of the four 
performance estimators and criterion measure was developed for various locations and 
each rating. Furthermore, a curvilinear regression analysis was applied to detertiine 
the best linear relationship between those variables. 

While the purpose of this project was not to evaluate the criterion measure (TPCF), 
conditional and joint freqijencies of the job tasks by rating revealed the modifications 
needed on the TPCF to make it more current. Furthermore, from the conditional and joint 
frequencies it was possible to develop a competency level for each rating and permit an 
in-depth analysis of the job task structure for those ratings. 

Comparisons between ships and ratings were made by employing the MRE since it was 
identified as a more promising performance estimator. Initially a tv/o-way Analysis of 
Variance was employed on the sample data. However, because of the significant inter- 
action that was found to exist between ships and ratings, comparisons between ships 
(ratings) were made for a fixed rating (ship). 

Finally, product-moment correlation coefficients were developed between various 
performance variables and several demographic variables. In particular, Basic Test 
Battery scores (GCT, ARI, MECH, and CLER scores), usually employed to predict actual 
school success, v/ere investigated in order to determine the degree of association 
between those scores and the measures of on-the-job performance developed in this 
research effort. 

Findings 

In order to determine the appropriateness of standard statistical techniques or 
tests employed for various purposes in this research effort, initial findings were 
concerned with the results of an analysis of the distributional properties of the predictor 
and criterion variables. From an application of appropriate poodness-of -f i t tests for 
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normality to tne sar.plQ data, only the prt^dictor variable WRE could be termed normally 
distributed. This result was also Q-^cerd.]! y true when individual ratings were similarly 
studied. These characteristics of ihe sar^-ple data necessitated the use of a curvi- 
linear regression analysis. An eiitphasis on only the 1 crast-squares analysis resulting 
from an application of that technique v^=js er^ployed in order to determine the relative 
merits of each of the predictor variables. 

A comparison of the n^ultiple correlation coefficients re:,ulting from the curvi- 
linear regression analysis applied across all ratings revealed that a straight-line was 
the best fit to the sa'nple data. The product-moment correlations between the predictor 
variables {SRE, PRE, GRE, and WRE) and the selected c»^iterion variable suggested moderate 
proiTiise on the Part of the WRE for appraising the on-the-job performance of individuals 
involved in electronics nn'ntenance activities. However, the relatively low multiple 
correlation coefficients suggesT^ed a significant degree of unexplained criterion variance. 
As such the analysis was applied by rating. Relevant findings by rating revealed that 
in almost every rating the WRE deniunst rated more promise for appraising on-the-job 
technician performance than the other estimators. The WRE AVds considered a more promising 
estimator in the sense that the sample product-moment correlation coefficients were 
generally of a larger magnitude and, by some fit to the data, the WRE seemed to account 
for more criterion variance. For example, the WRE indicated product-moment correlations 
of .492, .445, .430, and .434 for the EM, ET, FT, and IC ratings, respectively, while 
the next more promising estimator (GRE) demonstrated product-moment correlations of .301, 
.508, .374, c^nd .387 for the EM, ET, FT, and IC ratings, respectively. It is to be noted 
that while th3 WRE irtay not necessarily be a statistically significantly different estimator 
in terms of producing higher correlations with the criterion variable and explaining more 
criterion var^ance, the sample data results did tend to demonstrate that the WRE vvas the 
more promising estimator in that consistently the sample results did produce higher 
product-moment and multiple correlation coefficients for the WRE. Altogether the WRE 
demonstrated very promisirvj results on the EM, ET , FT, and IC ratings and fair results 
on the R^^, S", and TM ratings. Mone of the performance estimators v/ere at all promising 
in the RD rating. 

Relevant findings from an analysis of the Technical Proficiency Checkout Form re- 
vealed that it was a very instructive instrument for determining technician proficiency 
in one job task in relation to another. Only one job task - the calibrating of the 
equipment used by the technicians - seemed to be out of place in the hierarchial order 
of the job tasks represented by this instrument. 

Findings of the multiple comparison of ships and ratings included the result that 
significant interaction exists between ship-rating combinations. This resulted in the 
development of multiple comparisons of ships (ratincjs) for a fixed rating (ship). From 
this analysis it v/as found that no pairwise significant difference exists between ships. 
On some ships a pairwise significant difference exists betv^een some ratings, but no pat- 
tern emerged across ships as to which rating(s) demonstrated a higher or lower mean 
performance 1 evel . 

The product-moment correlation coefficients developed between the demographic vari- 
ables and the performance variables were of the same magnitude as those which are usually 
found to exist between predictor variables and measures of on-the-job performance. Prom- 
ising results were found in this research effort on the relationship of demographic vari- 
ables to on-the-job performance. 

Concl usions 

Employing the TPCF as a criterion measure of technician on-the-job performance it 
rnay be stated that the following list represents an accurate portrayal of the performance 
measurement technique that was r-3searched : 

1. The distribution of the predictor variables SRE, PRil , and GRE are 
generally skewed in one direction or another, while the criterion 
variable derived from the TPCF is negatively skewed. The WRL is 
norrnally distributed. These conclusions are for each rating and across 
rati nqs . 
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2. The WRE a more pronising type of performance estimator. It has 
greatest utility v,'hen applied to technicians in the EM, ET, FT, and IC 
rating and fair promise for application in the RM, ST, and TK ratings. 

3. None of the performance estimators is appropriate for use upon 
technicians in the RD rating. 

4. The Technical Proficiency Checkout Form (TPCF) demonstrated significant 
promise for appraising the job task structure and proficiency of electronics 
maintenance personnel without restriction to a particular rating. 

5. In all ratings a more current i'actor analytic task analysis would be 
desirable before implementation of the technique. This would involve a 
revision of the job activity factors on the JPQ ANSWER SHEET and job task 
descriptions on the TPCF by rating. 

6. It is recommended that a validation of the performance variables (SRE, 
PRE, GRE and WRE) be completed before the technique is applied to other than 
those ratings researched in this report. 

In conclusion it is to be noted that the performance measurement technique that was 
researched is of significant merit to be considered for practical application in the U.S 
Navy (particularly in the EM, ET, FT, and IC ratings). At the present stage in the art 
of developing performance measurement techniques, the technique that was researched is 
probably the best performance measurement procedure presently available for application 
within the U. 5. Navy. 
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INTRODUCTION 



Current and expanded commitme. <$ of a modern sophisticated Navy will require 
greater operational effectiveness of fleet personnel systems. The Navy will have to 
operate fleet personnel systems at optimal effectiveness levels and maintain fleet 
readiness. Together with these requirements, the advent of an all-volunteer force and 
smaller ship systems with reduced manning levels make the problem of optimizing, and 
evaluating, personnel system effectiveness a complex and critical problem. 

While performance assessment serves a multitude of purposes, it has been seen as 
an especially valuable tool when applied to the areas of optimizing personnel system 
performance, providing feedback on naval school effectiveness, the interpretation of 
man-machine interaction, and as a factor in the optimal assignment of men to jobs. 
It is in these applications that personnel systems performance measurement will be 
able to address some of the more critical present-day Navy problems. For example, 
many ship systems are operating with increasingly sophisticated and complex equipment. 
However, is it necessarily true that technicians of comparable sophistication in train- 
ing and mental ability need to be employed to operate, maintain, and repair that equip- 
ment In order that the ship complete its mission? While this report does not address 
that specific question, future research employing individual, and system, performance 
measurement may reveal that the Navy could effectively utilize personnel in those 
positions, who may now be rejected for some reason related to their projected on-the- 
job performance in those positions. As such there is a definite need for valid and 
reliable individual system performance assessment. 

In order to achieve a performance appraisal of personnel systems, recent research 
has been directed towards viewing personnel system performance estimation as analogous 
to equipment reliability estimation. This particular approach views individuals (in 
the system) as "components" in the personnel system. This viewpoint, and an applica- 
tion of the techniques already employed in equipment performance estimation, reduces 
personnel system performance estimation to an evaluation of the performance of the 
individuals in the system. Once the individual performance estimates have been made, 
meaningful combinations of these estimates can provide estimates of personnel system 
performance. As such the initial problem reduces to that of finding accurate and 
valid measurements of individual performance. 

Much recent research in the area of individual performance measurement has been 
directed towards examining individual performance as a function of the extremes of 
behavior (critical incidents) of an individual's performance. These functions of 
behavior can provide estimates of individual performance. By appropriate combina- 
tions of the individual performance estimates, estimates of personnel system per- 
formance can be developed. This report will address the validity, application » and 
implications of a particular procedure that employ?, the critical incidents technique 
to estiniate the performance of electronics maintenance personnel. 



BACKGROUND 



The purpose of this section is to give the reader a logical development of the 
ptTformance measurement techniques employed by Applied Psychological Services and 
others. Fundamentally these researchers employed a critical incidents technique in 
deriving estimates of human performance. 
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Generally the main approach is to estimate the performance of a particular person- 
nel system as a function of the performance of individuals that are a part of the 
system. This necessarily reduces personnel system performance estimation to a discus- 
sion of estimators of individual performance where individuals are the components of 
the system. Combining the individual estimates will provide estimates of personnel 
system performance. 

Personnel Performance Estimation 

Let UE (UI) represent an uncommonly effective (uncommonly ineffective) incident of 
performance observed by a rater in a certain time period on some individual under ob- 
servation. Furthermore, let ZUE (lUI) represent the total number of uncommonly ef- 
fective (uncommonly ineffective) incidents.of performance observed. Using these func- 
tions of critical incidents, Whitlock [21]' demonstrated that there is a definite 
straight line or curvilinear relationship between ZUE (or the ratio SUE/IUI) and cor- 
responding performance evaluations. Prior results such as this provided significant 
evidence that the application of a critical incidents technique to performance eval- 
uation is a valid and useful approach. 

Following upon the results of Whitlock, for example. Applied Psychological Services 
further developed and applied the above mentioned techniques to the post-training per- 
formance evaluation of individuals In various avionic or electronic ratings in the U. S. 
Navy. In particular Siege! and Pfeiffer [18], utilizing estimates of uncommonly ef- 
fective and uncommonly ineffective performances, showed that these estimates possess 
merit as useful indicators of overall personnel proficiency. The researchers employed 
magnitude estimates of the number of uncommonly effective and uncommonly ineffective 
performances relative to a short prior period for avionic personnel. They derived a 
performance index from the ratio of the sum of uncommonly effective performance (SUE) 
to the sum of uncommonly effective plus the sum of uncommonly ineffective performance 
(SUI), namely (I:UE/[ZUE +ZUI]). Siegel and Pfeiffer [18] concluded that: (1) 
magnitude estimates of uncommonly effective and ineffective performance yielded useful 
data which could form the basis for a personnel subsystem reliability indexj (2) the 
ratio of the sum of uncommonly effective to the sum of uncommonly effective plus the 
sum of uncommonly ineffective oerformance yields an index which discriminates in the 
anticipated direction; and, (3; the obtained avionic personnel subsystem index could 
be utilized for post-training performance appraisal, personnel placement, and squadron 
evaluation purposes. 

Job Performance Questionnaire 

Eight job activity factors descriptive of naval avionic electronic maintenance 
jobs were isolated by Siegel and Schultz [19] and are shown in Appendix A, page A-7, 
along with their definitions. These factors formed the basis of the Job Performance 
Questionnaire (JPQ), an instrument for recording the frequency of critical Incidents 
for each of the job activity factors. Siegel and Federman [16] demonstrated the 
utility and practicality of a Job Performance Questionnaire (Appendix A, page A-3) 
for technicians in the eight electronic maintenance ratings EM (electrician's mate), 
ET (electronics technician), FT (fire control technician), IC (interior communica- 
tions electrician], RD (radarman), RM (radioman), ST (sonar technician), and TM 
(torpedoman's mate). From an evaluation of 499 technician in those ratings, the 
researchers found that the JPQ yields an estimate of the total number of uncommonly 
effective and uncommonly ineffective incidents of behavior on the eight identified 
job activity factors. 



'All numbers enclosed in brackets refer to corresponding numbers of documents and 
publications listed under REFERENCES. 



ERIC 



2 



Specifically, for each job activity the reliability ratio (ZUE/[zUE + lUI]) yields 
an estimate of the probability of effective performance for the individual technician 
on the particular job activity considered. Then the reliability ratios are compounded 
to provide estimates of individual effectiveness or reliability of on-the-job perform- 
ance across the job activities. It was reported by Siegel and Federman [l6] that esti- 
mates cf uncommonly effective and of uncommonly ineffective behavior along all eight 
^MiTienslons of job activities could be combined into a meaningful measure of technician 
effectiveness. Moreover, they indicated that the individual technician effectiveness 
values can be further treated to form effectiveness values for ratings, ships, and 
squadrons. 

Estimation of Technician Reliability 

Employing the reliability ratio concept (ZUE/[ZUE + ZUI]), Siegel and Federman 
[16] have developed the following three reliability estimates: 

1) Series RgI lability Es timate (SRE) 

The series reHabiVity measure of total effectiveness for 
an individual is derived by multiplying individual job activity 
reliability ratios to yield a total reliability score, i.e., 

Rg = r-| X rg X . . . X rg 

where R^ = series reliability^, and 

r,- = (zyE/[ZUE + 2:ui]) is the reliability ratio for the 
1^" job activity. 

It is to be noted that use of the series reliability estimate 
requires the assumption that performance reliability on each job 
activity is independent of performance reliability on other job 
activities. 

2) Series Parallel Reliability Estimate (PRE) 

Siegel and Federman [l^J reported that "... the series and 
series-parallel reliabilities provide measures of personnel 
proficiency relative to performance on the entire job (i.e., 
all eight job activities).", (p. 46). The series-parallel 
estimate of individual proficiency is defined as: 

Rp = R3 x(2 - r^) X ... x(2 - rg) 

where R5 and r^ (1 = 1 , . . . , 8) are defined in 1) above. 



"^It is helpful to note that the series reliability estimate possesses the fol- 
lowing properties: 

a) for each of the 1=1, 8 job activities 
0 <_ r^ <_ 1 , and, therefore, 

b) 0 < R < 1 

— s - 

c) R3 ± smallest . 
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This particular estimate tends to provide a more optimistic 
estimate of individual performance. However, the content validity 
and derivation of this estimate deserves further development. 

3) Geometric Mean Reliability Estimate (GRE) 

Let r*, r*, r*, and r* be the four highest job activity reliability 

ratios of the e*)ght reliability ratios for a technician being evaluated. 
The geometric mean reliability for the technician is defined as: 



In addition to the three performance estimators (SRE> PRE, and GRE) previously in- 
troduced, this report will also discuss an estimate that weights the importance of each 
job activity in determining a technician's overall performance. 



4) Weighted Average Reliability Estimate (WRE) 
To develop this estimate let: 

NJ = number of job activities on which the technician actually 
worked; 

i = index for the sum over the job activities on which the 
technician actually worked; 

r-i = the reliability ratio for the 1^^ job activity; 

w^ = weight denoting the importance of the i^*^ job activity in 
estimating the technician's overall performance.*^ 

The Weighted-Average Reliability Estimate (WRE) of technician 
effectiveness is then defined as; 



Validation of Performance Estimators 

In addition to performance data collected on the JPQ, performance data were col- 
lected by Siegel and Federman [16] by means of an evaluative Instrument called the 
Technical Proficiency Checkout Form (TPCF) (Appendix A, page A-5). The TPCF consists 
of eight job tasks listed in hierarchlal order from easiest to most difficult. The 
eight tasks meet the Guttman requirements for scalability (see for example, Guttman 
[11]). Siegel, Schultz, and Lanterman [20], 1964» employed the scale underlying the 
eight tasks to determine the cutting points for placing avionic petty officers, third 
class and strikers in one of three levels of technical proficiency. The procedure for 
placing a technician in one of three levels of technical proficiency is accomplished by 
means of a Technical Proficiency (TP) score developed from the TPCF. 



procedure for deriving the weights is given in Appendix 




This particular estimate is an estimate of individual perform- 
ance that stresses the strong points of an individual's perform- 
ance. However, it also tends to ignore his weak points and, 
therefore, should be used with caution. 



Rw =^ X w^/NJ 
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Technical Proficiency (TP) Score 



Define the function F- (i 



, 8) as: 



F. = < 
1 



'l if the technician is CHECKED OUT on the i^h 
task of the TPCF 

0 if the technician is NOT CHECKED OUT on the 
i^h task of the TPCF. 



The TECHNICAL PROFICIENCY (TP) score for a technician is then defined as: 



8 

TP score = F ■ . 

1=1 ^ 



Technical Proficiency Checkout (TPC) Level 

Three TECHNICAL PROFICIENCY CHECKOUT (TPC) levels are: 



Level 1: above desirable 

Level 2: below desirable but at least minimally acceptable 

Level 3: below minimally acceptable. 

Siegel, Schultz, and Laterman [20] based this trichotomous division of the TPCF on 
supervisor's judgments of the performance level required for achieving the objectives 
given in Appendix A, page A-8. 

The procedure for determining the TPC level was reported on in the previously 
mentioned report and is given by: 

a) add 0.5 to TP score for an individual. Let TP* be the 
resultant score. 

b) 1f TP* < 3.9?, the TPC level = 3 



c) 1f 3.92 < TP* < 5.53, the TPC level = 2 

d) if TP* > 5.63, then TPC level = 1. 

Siegel and Flschl [17] correlated technicians TPC levels with the technicians total 
scores on a performance test. Employing a triserlal correlation coefficient (see, for 
example, Jaspen [13]) as an estimate of the product-moment correlation> they found a 
triserlal correlation of .40. When corrected for the lack of perfect reliability in the 
performance test criterion, the correlation became .74. On the basis of their investi- 
gation of the then concurrent validity of the TPCF, they concluded that the Technical 
Proficiency Checkout Form, "... previously shown to be reliable and practical, mny now 
be considered to possess a substantial degree of validity for appraising the absolute 
proficiency level of avionics technicians In the fleet.", (p. 46). Finally, Siegel 
and Federman [16] recorded a triserlal correlation of .38 between the TPC level of the 
technicians evaluated and their Series Reliability Estimate (SRE), concluding "... 
there is some basis to believe that the JPQ results correlate with on-the-job perform- 
ance.", (p, 62) . 



ERIC 



Main Results of Prior Studies 



Important conclusions of prior reports relative to the nieriti of the Series Re- 
liability Estimate (SRE) . Series-Parallel Reliability Estimate (Pl^ E), Geometric Mean 
Reliability Estimate (GRE) , and the Technical Proficiency Checkout Form (TPCF) are 
as follows: 

1. Reliability ratios of the form ^UE/(^UE + ZUl) indicate 
the probability of effective performance on a particular job 
activity for the technician being evaluated, 

2. The JPQ is an instrument for providing magnitude estimates 
of ^UE and ^UI for each man being evaluated by h'is immediate 
supervisor, 

3. The TPCF possesses a substantial degree of promise for 
appraising the absolute level of avionic technician proficiency. 

4. There is some basis {triserial correlation of .38 with TPC 
level) to believe that the SRE is a reasonably good estimator of 
on-the-job performance. 



PURPOSE 



The purpose of this research effort is to report on the data collection effort and 
data reduction methods and analyses that have been performed for the Office of Naval 
Research (ONR) under the project entitled Personnel Technology: Relating Individual 
Performance Effectiveness to Unit and Ship Effectiveness (Project Order Number: 
PO 2-0046 NR 150-336). The goal of this research project is to provide an empirical 
basis for assessing the utility to the Navy of a performance measurement technique de- 
veloped under a prior ONR contract. Under that contract Dr. Arthur I. Siegel, Philip 
J, Federman, and their associates of Applied Psychological Services, Inc, , Wayne, Pa., 
developed fleet post-training performance evaluative measures which have potential value 
for eventual widespread implementation within the U, S, Navy. The results of their study 
were contained within the report - Development of Performance Evaluative Measures : 
Investigation into and Application of a Fleet Post-Training Performance Evaluative 
Syste m [16J . An outgrowth of that effort was the suggestion that the technique be em- 
ploye? on a limited basis by a Navy laboratory to identify areas of modification upon 
operational testing. In response to that recommendation the Naval Personnel Research 
^nd Development Laboratory submitted a proposal to ONR to accomplish that task. Es- 
sentially the research effort undertaken by NAVPERSRANDLAB was accomplished by repli- 
cating the efforts of Siegel and Federman [16]. 

A second major objective of this research effort was to further develop the per- 
formance measurement techniques of Siegol and Federman [16], Furthermore, similarly 
related performance measurement techniques were researched with a view towards possible 
implementation of those techniques within the U. S. Navy. 



DATA COLLECTION 



The procedures employed in data collection for this project c'losely paralleled 
those employed by Siegel and Federman [16], with some modification^^ in the research 
instruments. This procedure was adopted so that a similar statistical analysis on the 
same type of population would permit some comparisons to be made between the results 
of this research effort and the results obtained by Siegel and Federman [16]. 



Every effort had been made to minimize interfering with normal shipboard duties. 
For this reason the data collection procedure centered upon the efforts of ship liaison 
officers conducting the data collection aboard each ship. Appendix B contains a dis- 
cussion on the procedures for the data collection reflecting various aspects of the ef- 
fort that resulted in the orderly and successful completion of the task.^ 

Data Collection Instruments 

An example of the performance evaluation forms that were completed by each super- 
visor for each technician evaluated are given in Appendix A. The instruments ar^^ 
optical scanning forms, thus, making them machine-readable and more capable of being 
placed in an operational mode. In particular the forms were: 

1) Job Performance Questionnaire (JPQ) ANSVIER^SHEET 

This form serves the same purpose as the JPQ discussed earlier, 
i.e., to record estimates of the total number of uncommonly ef- 
fective (lUE) and uncommonly ineffective (lUI) performances the 
supervisor has observed on each of the eight job activities for 
each man he is evaluating. 

2) Technical Proficiency Checkout Form (TPCF) 

This form is essentially identical tc the TPCF used by Slegel 
and Federman [16]. 

3) Personnel Identification Information Form (PIIF) 

This form was concerned with the background data of the man 
being evaluated. It was completed in part by his supervisor 
with the Administrative Officer providing the remaining informa- 
tion. 

Analyses Based o n the Data Collection Effort 

Employing the data collection instruments discussed in the previous section, per- 
formance data were collected with the assistance of men and ships of Commander; Cruiser- 
Destroyer Flotilla NINE (located at San Diego, California) and men and ships of Com- 
mander; Cruiser-Destroyer Force Atlantic Fleet (located at Newport, Rhode Island, and 
Boston, Massachusetts).^ The participating ships and type are shown in Table 1 along 
with the number of men evaluated by rating and ship for each location. 

Analyses Based on the Job Performance Questionnaire 

A descriptive analysis of each of the performance estimators (SRE, PRE, GRE, and 
WRE) derived from the Job Performance Questionnaire (JPQ) is presented in Figures 1, 2, 
3, and 4 and in the form of histograms. Each of these histograms was developed on 949 
technicians and based on the performance estimators which are continuous over the range 
of 0.0 to 1.0. Class intervals are numbered from 1 through 21 where a given class Inter- 
val Is of length .05. Class intervals corresponding to each of the numbered intervals 
are provided in Table 2. 



For the interested reader Appendices C and D contain the instructions for the ship 
liaison officer and the technician supervisor, respectively. 

^Henceforth in this report Location No. 1 will refer to ships at San Diego, Calif., 
and Location No. 2 will refer to ships at either Newport, R.I., or Boston, Mass. 
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TABLC 1 

NUMBER OF riEN IN EACH RATING A'lD SHIP 



CRUDESFLO.' MINE (Location Uo. ]) 



Ship 


TypL> 


EM 


ET 


FT 


IC 


RD 


RM 


ST 


TM 


TOTAL 


USS AGERHOLM 


DD-826 


6 


7 


7 


4 


5 


5 


5 


3 


42 


USS BROOKE 


DEG-1 


6 


8 


16 


3 


10 


8 


9 


1 


61 


IIQQ rnrtv 
Uoo bKMY 


Ut - 1 UZiH 


c 

J 


1 u 




A 
H 


Q 


7 
/ 


Q 


1 
1 


ou 


USS HORME 


DLG-30 


4 


12 


11 


6" 


5 


5 


8 


2 


53 


USS HULL 


DD-945 


3 


9 


R 


3 


9 


9 


8 


1 


50 


USS JOUETT 


OLG-29 


5 


10 


12 


5 


7 


fi 


9 


2 


57 


USS PRAIRIE 


AD-15 


fi 


29 


12 


6 


0 


10 


C 


13 


76 


USS RUPERTUS 


DD-851 


5 


11 


3 


2 


9 


9 


10 


1 


50 


USS SHELTON 


DD-790 


4 


5 


5 


1 


5 


5 


5 


0 


30 


USS SOUTHERLAND 


DD-743 


5 


8 


9 


5 


11 


11 


9 


2 


60 


USS HENRY W. TUCKER 


DD-875 


5 


9 


0 


3 


13 


11 


n 


2 


54 


TOTAL 




54 


113 


88 


42 


83 


86 


83 


28 


582 




CRUDE SLANT 


(Location 


No. 


2) 














Ship 


Type 


EM 


ET 


FT 


IC 


RD 


RM 


ST 


TM 


TOTAL 


USS BASILONF 


DD-824 


4 


4 


5 


Q 


Q 


5 


5 


0 


23 


USS DEALF.Y 


DE-1006 


3 


6 


5 


2 


3 


4 


6 


1 


30 


USS DEWEY 


DLG-14 


6 


6 


6 


4 


6 


5 


6 


2 


41 


USS FJSKE ^Boston) 


DD-842 


5 


4 


5 


0 


5 


5 


6 


0 


30 


USS J. A. FURER 


DEG-6 


4 


5 


14 


4 


5 


8 


5 


2 


47 


USS GARCIA (Boston! 


DE-1040 


4 


6 


6 


2 


6 


8 


10 


2 


44 


USS GLOVER (Boston) 


AGDE>1 


4 


7 


3 


0 


6 


6 


12 


1 


39 


USS HI'CH PURVIS 


DD-709 


6 


7 


10 


0 


15 


0 


9 


2 


49 


USS TALBOT 


DEG-4 


5 


5 


9 


2 


5 


5 


5 


0 


36 


USS JOHN WILLIS 


DE-1027 


2 


5 


3 


2 


5 


5 


5 


1 


28 


TOTAL 




43 


55 


66 


16 


56 


51 


69 


11 


367 


TOTAL (BOTH LOCATIONS) 




97 


173 


154 


58 


139 


137 


152 


39 


949 
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Fig. 1. "Histogram of Series Reliability Estimates (SRE) 
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Fig. 4. --Histogram of Weighted-Average Reliability Estimates (WRE) 
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TABLE 2 

CLASS INTERVALS FOR HISTOGRAMS 



Class Interval 
Number 


Lower 
Boundary 


Upper 
Boundary 


1 


0.96 


1 .00 


2 


0.91 


0.96 


3 


0.86 


0.91 


4 


0.81 


0.86 


5 


0.76 


0.81 


6 


0.71 


0.76 


7 


0.66 


0.71 


8 


0.61 


0.66 


9 


0.56 


0.61 


10 


0.51 


0.56 


11 


0.46 


0.51 


12 


0.41 


0.46 


13 


0.36 


0.41 


14 


0.31 


0.36 


lo 




0 31 


16 


0.21 


0.26 


17 


0.16 


0.21 


18 


0.11 


0.16 


19 


0.06 


0.11 


20 


0.01 


0.06 


21 


0.00 


0.01 
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Further analysis of results on the JPQ ANSWER SHEET indicated a high frequency of 
nonresponse in some job activities and ratings. The type of nonresponse that resulted 
was for the case In which the man being evaluated did not work at the particular job 
activity under consideration. Furthermore, there was also a significantly high pro- 
portion of men who, while they worked at the job activity being considered, received 
ZUE = 0 and ^iil = 0 from their supervisors. These observations required the con- 
sideration of two important areas relative to the JPQ. 

Problems In Calculating Performance Estimates . As discussed In the Background 
section of this report, reliability ratios of the form (J^UE/[SUE + ^UI]) were derived 
for each man on each of eight job activities and these ratios were combined to form 
the SRE, PRE, and GRE. However, the following two cases require the adoption of some 
convention In order to calculate the reliability ratios: 

1) the technician did not work at that job activity, or 

2) the technician received ZUE = 0 and lUl = 0 by the supervisor, 
implying that the reliability ratio 0 is undefined. 

By observing the frequency with which such cases occur across all 21 ships partici- 
pating in the project, it is possible to determine the extent to which any convention 
for estimating performance in those cases would effect individual SRE, PRE, and GRE 
values. A complete discussion of this effect is given in Appendix E. Summarizing, 
the above two cases can have a dramatic affect upon the individual performance esti- 
mates and these estimates will be greatly influenced by the convention that is adopted. 

A Convention for Estimating Performance 1n Certain Job Activities . Siegel and 
Federman [16] employed "... the average value for his rating on his ship (p. 28), 

OP those job activities which the technician did not work at or received ZUE = 0 and 
^■Ul = 0 by his supervisor. Unfortunately the results of the data collection effort at 
Location No. 1 (Destroyer Flotilla NINE) and at Location No. 2 (Cruiser-Destroyer Force 
Atlantic Fleet) Indicated that this tec' n'que was not feasible. ° 

In order to overcome this problem, the convention adopted in this report was to 
employ a composite reliability value across all shirs at a location for each job ac- 
tivity and rating. Appendix F discusses the proce'-.re for deriving the composite re- 
liability values, as employed in this report. 

Analyses Based on the Technical Proficiency Checkout Form 

Table 3 represents the numbers of men at each of the three TPC levels by rating 
and ship and across each rating arfd ship at Location No. 1. Table 4 reflects the same 
information for Location No. 2. It will be remembered that level 1 reflects an "above 
desirable" proficiency level while level 3 reflects a "below minimally acceptable" 
proficiency level . 

In addition to the TPC levels, TP scores were developed. A histogram of the re- 
sulting TP scores for the 949 technicians evaluated is presented in Figure 5. Almost 
identical histograms of TP scores were obtained for data collected at the two locations. 
Hence, only one histogram is presented. 



On every ship sampled at those locations there were ratings for which in some job 
activities those two cases occurred for all men in that rating. Appendix F provides a 
detailed account of this problem for the interested reader. 
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TABLE 3 

NUMBER OF MEN AT EACH TECHNICAL PROFICIENCY CHECKOUT (TPC) LEVEL 

Location No. 1 



RATI NG 


LEVEL 


1 


2 


3 




5 




1 




r 


1. 

4 


L 


1 


EM 


2. 


1 


1 

1 


n 
u 


1 

1. 


1 

1. 




3 


1 


0 


1 


1 


1 




1 




D 


7 


Q 


7 


ET 


9 
L 


9 
L 


9 


T 


1 


2 




3 


1 


0 


0 


2 


0 




1 

L 


C 


1 n 






g 


FT 


9 


9 




Q 


Q 


0 




T 

J 


n 

u 




2 


1 


Q 




1 


2 


2 


2 


5 


1 


IC 


2 


1 


0 


1 


1 


1 




3 


1 


1 


1 


0 


1 




1 


0 


0 


0 


0 


0 


RD 


2 


1 


1 


1 


0 


1 




3 




9 


8 


5 


8 




1 


1 


3 


7 


0 


0 


RH 


2 


1 


U 


C 


0 


8 




3 


3 


1 


0 


5 


1 




1 




7 


7 


6 


3 


ST 


2 


1 


2 


0 


1 


2 




3 


0 


0 


2 


1 


3 




1 


2 


1 


0 


2 


1 


TM 


2 


1 


0 


0 


0 


0 




3 


0 


0 


1 


0 


0 


EACH 


1 


22 


3U 


30 


3U 


21 


SHIP 


2 


10 


15 


5 




17 




3 


10 


12 


15 


15 


11* 



SHIP 

EACH 



6 


7 


8 


9 


10 


11 


RATING 


ii 


5 


3 


2 


5 


3 


38 






2 


2 




2 


12 


0 


0 


0 


0 


0 


0 




g 


17 


g 


5 


8 


7 


86 


1 


g 


2 


0 


0 


\ 


2 5 


1 


3 


1 


0 


0 


1 


9 


8 


6 


2 


2 


5 


0 


59 


3 


3 


0 


3 


0 


0 


16 


1 


3 


1 


0 


\\ 


0 


13 


3 




2 


1 


2 


2 


26 


2 


1 


0 


0 


3 


0 


10 


0 


1 


0 


0 


0 


1 


6 


0 


0 


0 


0 


1 


0 


1 


0 


0 


8 


0 


3 


0 


15 


7 


0 


1 


5 


7 


13 


67 






1 


5 


0 


0 


25 


2 


3 


5 


0 


2 


8 


33 


0 


3 


3 


0 


9 


3 


28 


6 


0 




5 


5 


5 


52 


0 


0 


6 


0 






20 


3 


0 


0 


0 


0 


2 


11 


2 




1 


0 


2 


2 


17 


0 


3 


0 


0 


0 


0 




0 


6 


0 


0 


0 


0 


7 


35 


UO 


21 


20 


28 


19 


30U 


9 


20 


23 


5 


12 


15 


133 


i:^ 


IR 


6 


5 


20 


20 


1U5 
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TABLE 4 • 

NUMBER OF MEN AT EACH TECHNICAL PROFICIENCY CHECKOUT (TPC) LEVEL 

Location No, 2 



TPC ^"'^ EACH 

RAT I MG 

26 
11 
6 



RATING 


LEVEL 


1 


2 


3 


k 


5 


6 


7 


8 


9 


10 




1 


2 


2 


3 


k 


3 


0 


2 


5 


k 


1 


EM 


2 


2 


0 


1 


1 


1 


2 


1 


1 


1 


1 




3 


0 


1 


2 


0 


0 


2 


1 


0 


0 


0 





1 


3 


5 


5 


3 


5 


5 


7 


7 


2 


3 


U5 


ET 


2 


1 


1 


1 


0 


n 


1 


0 


0 


2 


1 


7 




3 


0 


0 


0 


1 


0 


0 


0 


0 


1 


1 


3 





1 


2 


k 


u 


k 


12 


FT 


2 


1 


0 


2 


1 


2 




3 


2 


1 


0 


0 


0 




1 


0 


0 


0 


0 


1 


IC 


2 


0 


1 


2 


0 


1 




3 


0 


1 


0 


0 


2 



U 1 7 8 2 U8 

2 2 3 1 1 15 

0 0 0 0 0 3 

0 0 0 2 1 6 

0 0 0 0 0 U 

2 0 0 0 1 6 





1 


0 


0 


0 


0 


0 


1 


2 


0 


0 


0 


5 


RD 


2 


0 


0 


6 


k 


0 


1 


k 


6 


0 


5 


26 




3 


0 


3 


0 


1 


5 


k 


0 


9 


5 


0 


27 





1 


3 


3 


k 


1 


7 


2 


0 


0 


0 


0 


20 


RM 


2 


2 


1 


1 


u 


1 


6 


3 


0 


k 


0 


22 




3 


0 


0 


0 


0 


0 


0 


3 


0 


1 


5 


9 




1 


5 


2 




3 


k 


5 


7 


9 


k 


2 




ST 


2 


0 


2 


0 


2 


0 


1 


0 


0 


1 


1 


7 




3 


0 


2 


2 


1 


1 


k 


10 


0 


0 


2 


22 




1 


0 


0 


0 


0 


2 


1 


0 


1 


0 


1 


5 


TM 


2 
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1 


1 


0 


0 


0 


1 


1 


0 


0 


k 




3 


0 


0 


1 


0 


0 


1 


0 


0 


0 


0 


2 



EACH 


1 


15 


16 


22 


15 


3U 


18 


lU 


29 


20 


10 


193 
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Fig. 5.— Histogram of Technical Proficiency Scores 
(N = 949) 
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APPROACH 



An approach to the stattstlcal analysis of the data Involved the selection of ap- 
propriate analyses within, four general areas: 

1. The validity of the performance estimators SRE, PRE, GRE, and 
WRE with respect to a selected criterion measure. 

In order to determine the validity of the four performance es- 
timators (SRE, PRE, GRE, and WRE) for predicting on-the-job per- 
formance of the electronics maintenance personnel involved in the 
research effort, the results of the TPCF were used as a criterion 
measure of absolute technician proficiency. The belief that the 
TPCF reflects the on-the-job performance of -electronics maintenance 
personnel must rest to a large degree upon related results of prior 
research efforts. In particular, from references that were cited in 
the section Validation of Performance Estimators . 

Initially, in order to determine the degree of association between 
the performance estimators (SRE, PRE, GRE, and WRE) and the selected 
criterion variable (TPC level), trlserial correlation coefficients 
were developed by loctcion. Due to the extreme skewness of the dis- 
tribution of the underlying continuum (represented by TP score, see 
Figure 5), a test of normality of TP score was executed to determine 
the appropriateness of triserial correlation. This resulted in the 
choice of a curvilinear regression analysis as a better approach for 
validating the performance estimators by location and subsequently 
by rating with TP score as the continuous criterion measure. 

2. An evaluation of technician job competency as determined or 
implied by the TPCF. 

The appropriateness of the job tasks represented on the TPCF 
was approached by developing a frequency table of men CHECKED OUT 
and NOT CHECKED OUT by rating on each job task. The agreement 
of each job task to the hierarchial classification of the tasks 
provided some indication of the extent to which it was still 
applicable to electronic maintenance activities. A more de- 
tailed analysis of the TPCF that included the development of 
sample conditional and joint frequency tables allowed the 
development of a procedure for deterrriini ng technician job 
competency within a rating. Furthermore, these analyses re- 
vealed areas of suggested modifications of the TPCF prior to 
its implementation* 

3. Multiple comparisons between ratings or ships with respect to 
their average performance levels. 

The approach employed in this report to develop comparisons 
between ratings and between ships was an additive model suggested 
by a two-way fixed effects analysis of variance witli interaction. 
Th^s required the selection of the appropriate variable, from 
among SRE, PRE, GRE» WRE, and TP score, upor^ which to base the 
comparisons. The variable selected was the one which best met the 
statistical requirements, i.e., normality of the variable, homo- 
geniety of variances over the main effects, and independence of 
ship, rating, and cell observations. 

4. Degree of association between various uemographic variables 
and the performance variables. 
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From the demographic information collected on the Personnel 
Identification Information Form (PIIF), product-moment cor- 
relations between the demographic variables, and the perform- 
ance estimators (SRE, PRE, GRE, WRE, and TP score) were developed. 
This same approach was applied to each of the eight job activities 
in order to determine If any job activity related to a particular 
demographic variable. 

These areas are the most rewarding in the sense that they would provide some in- 
sight Into the merits of the performance measurement technique being researched and of 
the Implications for its application within the U. S. Navy. 



RESULTS AND DISCUSSION 



Validity of the Performance Estimators 



Triserial Correlation Analyses 

Initially sample mean reliabilities were developed for each of the four performance 
estimators (SRE, PRE, GRE, and WRE) for each TPC level. The mean reliability values are 
the average values of the performance estimators in the TPC levels, therefore^ the mean 
values would be expected to be smaller for a lower proficiency level. The results of 
this phase of the statistical analysis are presented in Table 5 for technicians at those 
ships sampled at Location No. 1, Location No. 2, and combined locations. 

Employing the results of Table 5, triserial correlation coefficients were developed 
between each of the performance estimators (SRE, PRE, GRE, and WRE) and Technical Pro- 
ficiency Checkout (TPC) level for technicians sampled at each location and combined lo- 
cations. Table 6 presents the resulting triserial correlations. 

Comparing the locations, particularly with respect to the SRE, PRE, and GRE, only 

the triserial correlation coefficients for data collected at Location No. 2 agre.-e with 

Siege! and Federman's prior results [16]. This observation required a consideration 

of the appropriateness of triserial correlation to the data collected in this project. 

Application of the triserial correlation coefficient involves the following re- 
quirements: 

a) the segmented variable 1s basically continuous and normally 

distributed; and, 

b) all the segments which together would form a whole normal 

distribution are present. 

Consider again the histogram In Figure 5. Recall that the variable. Technical 
Proficiency score (TP score), was segmented Into one of three, levels of technician 
proficiency. This histogram represents the entire distribution of the segmented 
variable, which may be taken as continuous and Is clearly negatively skewed. A 
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TABLE 5 
MEAN RELIABILITIES 









Location 


No. 


1 












Mean 


Reliabilities 


In Each 


TPC Level 


TPC 


LEVEL 


N 


SRE 




PRE- 


GRE 


WRE 




1 


303 


.351 




.597 


.931 


.657 




2 


134 


.331 




.553 


.919 


.566 




3 


145 


.427 




.625 


.923 


.557 








Location 


No. 


2 












Mean 


Reliabilities 


1n Each TPC Level 


TPC 


LEVEL 


N 


SRE 




PRE 


GRE 


WRE 




1 


193 


.361 




.629 


.947 


.642 




2 


96 


.213 




.380 


.928 


.557 




3 


78 


.141 




.338 


.878 


.502 








Combined Locations 












Mean 


Reliabilities 


In Each 


TPC Level 


TPC 


LEVEL 


N 


SRE 




PRE 


GRE 


WRE 




1 


496 


.355 




.608 


.937 


.651 




2 


230 


.283 




.483 


.923 


.562 




3 


223 


.328 




.524 


.:"'07 


.538 
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TABLE 6 

TRISERIAL CORRELATION ANALYSES 



Performance Estimators 





N 


SRE 


PRl 


GRE 


WRE 


Location No. 1 


582 


-0.090* 


-0.015 


0.031 


0.256* 


Locatton No. 2 


367 


0.340* 


0.335* 


0.235* 


0.335* 


Combined Locations 


949 


0.061 


0.1.22* 


0.099* 


0.283* 



*Significar»tly different from zero at the a = ,05 level. 



goodness of fit test for normality [5 ] was applied to the distribution of TP scores of 
the 949 technicians. This test statistic will be called the g-j test statistic' 

When the g-] test statistic was applied to the sample data of TP scores, the re- 
sulting test statistic values were 

g^ = -.5123, implying 2 = 6.4632. 

Therefore, the assumption of normality for TP scores must be rejected fnr the sample 
data collected on the population of electronics maintenance personnel ^949 technicians 
in the sample) . 



^The g^ test statistic Is given by g = ^Y[X - Tj-^ 

rax - T)2]3/2 

where X represents an observation, J the sample mean, and N is the sample size. If 
the null hypothesis is that the underlying distribution is normal, 



then it has been shown [5 ] that 2 = Qi ^ / (N + 1) (N + 3) 

^ ^ 6(N - 2) 



is approximately normal with mean zero and variance one. In fact a test of the 
hypothesis that the underlying distribution 1s normal (at the ef = .05 level of signfi- 
cance) is given by: 

reject the null hypothesis of normality if 
2 is greater than 1.96 or less than -1,96, 

This particular goodness of fit test has several advantages over the usually ap- 
plied Kolmogorov-Smlrnov tests or the well known Chi-square tests in that, in particular, 
the population mean and standard deviation need not be known and the test need not be 
applied just to large samples. Furthermore, this test is more sensitive to departures 
from normality due solely to skewness than the other two tests [5], 
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The gi test statistic was a^so applied to the distribution of TP scores at either 
location. The test statistic values were g] = -.4930, 2 = -4.8810 and = -.5473, 
z = -4.3156 at Location No. 1 and Location No. 2 respectively. Therefore, at both 
locations the assumption of normality of TP scores must be rejected. These results 
were verified by the histograms of TP scores for those locations. In both cases these 
histograms demonstrated the negative skewness of the distribution of TP scores. 

Curvilinear Regression Analysis 

Essentially due to the ^lon-nonnality of the TP scores, an alternate analysis was 
employed in order to determine the degree of association between the predictor vari- 
ables (SRE, PRE, GRE, and WRE) and criterion variable (TP score). The particular pro- 
cedure to be employed to achieve this end was a curvilinear multiple regression pro- 
cedure outlined in Cooley and Lohnes [3]. A few remarks on this subject for the 
purposes of this report have been provided in Appendix G. 

Appendix H provides the results of the analyses of these predictor and criterion 
variables for the total of 949 technicians sampled. Similar results as found in Ap- 
pendix H were also developed for Location Mo. 1 and Location No* 2. Although those 
printouts are not presented in this report, the essential information from those 
printouts is given in Table 7° along with the essential information from Appendix H. 

Consider Table 7 and the evaluation of SRE as a predictor of TP score for the two 
locations combined. The product-moment correlation between SRE and TP score is .055 
(not significantly different frotn zero at the a = ,05 level). In attempting to fit a 
linear, quadractic, and cubic model to the data of SRE valuer, and TP scores, the 
multiple correlation coefficient (R^) values were .003, .007, and .043 respectively. 
However, in view of the fact that the residual mean square does not change from the 
linear to cubic modes "'t would be just as well to chose the linear model (particularly 
since R^ for the cubic equation is not significantly larger than ,007). Therefore, 
from Appendix H, the best regression equation is 

TP score = 5.219 + 0.397 SRE, 

Because SRE and TP score are essentially independent, the best estimate of SRE will 
always be the mean of the observed TP scores, regardless of the observed SRE. This 
result is further reflected in noticing that the sample mean TP score is 5.350, ap- 
proximately equal to 5,219 - the-TP score intercept of the regression line. 

Observing the results of Table 7 for the predictor variables PRE and GRE on the 
two locations combined* only minimal improvement can be made with these estimates over 
the SRE. In fact the GRE is almost identical to the SRE and for practical purposes 
cannot be held to possess significant merit. The PRE is modestly better with a cor- 
relation of ,1. However, for the PRE, the highest R^ value does not even reach .05, 
a long way from a perfect fit with an value of 1.0. Based upon this analysis, PRE 
must be termed only slightly better than the SRE and GRE. 

The WRE provides the most promising and consistent (over locations) estimator of 
the four predictors considered. It is most promising in the sense that it provides 



All of the computer printouts on the curvilinear regression procedure employed 
1n this report are in terms of ''centered data." This technique Improves the computation 
of the printout values by minimizing roundoff errors. Therefore, when reviewing the 
results of Table 7, one must be concerned with tne relative magnitude of the residual 
mean square in attempting to fit a linear model versus fitting a higher order model. 
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TABLE 7 

CURVILINEAR REGRESSION ANALYSES BY LOCATIONt 







Location 


No. 1 
















Type of 


Curve 






Predictor 




Linear 


Quadratic 


Cubic 


Variable 




r2 




r2 




r2 




SRE 


-.069 


.005 


.002 


.007. 


.002 


.072 


.002 


PRE 


-.009 


.000 


.002 


.043 


.002 


,047 


.002 


6RE 


.024 


.001 


.002 


.003 


.002 


.004 


.002 


WRE 


.242* 


.058 


.002 


.058 


.002 


.062 


.002 






Location 


No. 2 
















Type of 


Curve 






Predictor 




Linear 


Quadratic 


Cubic 


Variable 


r 


r2 




r2 


2 

s 


r2 




SRE 


.288* 


,083 


.003 


.083 


.003 


.090 


.003 


PRE 


.277* 


.077 


.003 


,078 


.003 


.100 


.002 


6RE 


,212* 


.045 


.003 


.047 


.003 


,052 


,003 


WRE 


.292* 


,085 


,003 


.085 


.003 


.089 


.003 






Locations Combined 
















Type of Curve 






Predictor 




Linear 


Quadratic 


Cubic 


Variable 


r 

xy 


r2 






2 

s 




2 

s 


SRE 


.055 


.003 


.001 


,007 


.001 


,043 


.001 


PRE 


,100* 


.010 


.001 


.036 


.001 


.036 


.001 


GRE 


.087* 


.008 


.001 


.008 


.001 


.009 


,001 


WRE 


.257* 


.066 


.001 


.066 


.001 


.071 


.001 



tR = r^., in the linear case. 



*Significantly different from zero at the a = .05 level. 

r^y = product-moment correlation coefficient between the predictor 
variable x and the criterion variable y (TP score). 

r2 = multiple correlation coefficient. 

s^ = residual mean square 



the highest product-moment correlation coefficient with the selected criterion variable, 
TP score. However, it cannot be said that it better fits the data than any of the other 
three estimators with respect to the three types of curves considered. 

The curvilinear regression for the predictor variable WRE, Appendix H, page H-6, 
indicates that a linear curve is the best fit to the data. The regression equation is 
given by 

TP score = 3.571 + 2.95 WRE. 

In comparison to the other estimators the WRE can be said to possess moderate validity 
at best for appraising an absolute level of technician performance. As such its ap- 
plication to the population of electronics maintenance personnel is tenuous. 

Analyzing the results at either location again points out the differences between 
the results obtained at either location. However, this is due mainly to a difference 
in r^ values and not to values for goodness of fit of the linear, quadratic, and 
cubic models from one location to the next. This may be due to the high degree of un- 
explained criterion variance in the data at either location and with respect to the 
locations combined. Scatterplots of the data in those three cases with respect to 
each predictor variable verified the high degree of dispersion in the data and the lack 
of any obvious pattern or functional relationship in those plots. 

Within Rating Analyses 

A factor that may influence the frequency with which a population does not work 
at a particular job activity is, of course, the appropriateness of the job activity to 
present-day electronic maintenance activities* The most homogeneous type of sub- 
population that would reflect most members of the subpopul ation working at the same 
job activities should be rating. It is mainly for this reason that the subpopulations 
considered in this report are ratings, and not, for example, ships within locations 
which should (and did) reflect results similar to those found in Appendix H. In order 
to perform the most general type of analysis to determine the validity of the perform- 
ance estimates, a curvilinear regression analysis as previously discussed and employed 
in Appendix H was applied per rating for each of the four predictor variables - SRE, 
PRE, GRE, and WRE. Appendix 1 gives the resulting 32 printouts of the Cooley and 
Lohnes [3] curvilinear regression analysis. The object is to select for each rating, 
the best of three possible curves - linear, quadratic, and cubic - for each performance 
estimator which best fits the data in terms of significantly larger multiple correlation 
coefficients for smaller residual mean squares. Comparisons between the performance 
estimators may then be made by performing an appropriate test of hypothesis of the equality 
of two correlation coefficients (or multiple correlation coefficients). The test that 
is usually applied is the "Fisher's z" test which employes the asymptotic distribution of 
the sample correlation coefficient. However this test requires that the distributions 
of the underlying populations are bivariate nonrfal (see Anderson [1], page 78) • Because 
the distribution of TP scores and the SRE, PRE, and GRE were not normally distributed 
with respect to the individual ratings, the appropriateness of employing this test is 
in question. Furthermore the literature seems to be vacant of a discussion of the 
robustness of the test. Therefore the approach must be in terms of comparing the observed 
sample product-moment correlations, and, in particular, on the amount of criterion 
variance explained by the variables. This approach will not necessarily produce a 
statistically significantly different performance estimator but one which is a more 
promising estimator, in terms of the sample information. 

The following outline represents the essential results of the curvilinear regres- 
sion analyses presented 1n Appendix I. The results are presented by rating in Tables 
8 through 13 together with observations and recommendations. 
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TABLE 8 

EM CURVILINEAR REGRESSION ANALYSES (N = 97) 



Type of Curve 



Predictor 




Linear 


Quadratic 


Cubic 




Variable 








r2 




r2 




SRE 


.335* 


.133 


.009 


.136 


.009 


.176 


.009 


PRE 


.247* 


.061 


.010 


.133 


.009 


.113 


,009 


GRE 


.301* 


.090 


.010 


.154 


.009 


.221 


,008 


WRE 


.492* 


.242 


.008 


. 25^ 


.008 


.300 


.008 


1 Significantly different from 


zero at 


thp a = 


.05 'level. 







K EM rating - Clearly the estimator WRE demonstrates the best fit 
to the data. The product-moment correlation of .492 indicates at 
least a fair degree of association of the WRE with the technician's 
absolute performance level. (Although the value is significantly 
better for the cubic curve over the other two curves, the value of 
.300 in that case can only indicate a moderate fit of the cubic curve 
to the data. 

TP score = 4.849 - 15.571 WRE + 44.319 WRE^ - 26.561 WRE^. 

The other estimators do not demonstrate a better fit to the data 
than the WRE. In view of this and other considerations (e.g., the 
examination of the scatterplots) , the WRE is recommended for applica- 
tion in this rating for those situations in which the probability of 
effective perfor;mance of an individual in the EM rating is required. 



TABLE 9 

ET CURVILINEAR REGRESSION ANALYSES (N = 173} 



Type of Ctjrve 



Predictor 




Linear 


Quadratic 


Cubic 


Variable 


r 

xy 












2 

s 


SRE 


.318* 


.101 


.005 


.142 


005 


,142 


.005 


PRE 


.366* 


.134 


.005 


.135 


.005 


.135 


.005 


GRE 


.508* 


.258 


.004 


.266 


.004 


.271 


.004 


WRE 


.445* 


.198 


.005 


.209 


.005 


.210 


.005 


♦Significantly different from 


zero at 


the a = 


.05 level . 
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2. ET /^ating - For this rating two slgnTficant estimators arise, the 
GRE and WRE. The WRE is still a promising estimator even though it 
has a lower product-moment correlation than the GRE (.445 versus .508) 
and does not fit the data as well. The GRE values may be spurious 
observations for this rating for it is not significantly higher in 
any other rating. However, without evidence of this fact it is recom- 
mended that either the GRE or WRE be employed in this rating. Further- 
more, the values of the product-moment correlations for those esti- 
mators reflect at least i\ moderate degree of association with TPCF 
results. 

Because the R^ values do not change appreciably from one type of 
curve to the next, it is recommended that the linear model be em- 
ployed for prediction purposes in either case. The linear curves 
are: 

TP score = 2,99 + 4.03 GRE, and 
TP score = 4,344 + 3,79 WRE. 



TABLE 10 

FT CURVILINEAR KcGRESSION ANALYSES (N = 154) 



Type of Curve 



Predictor Linear Quadratic Cubic 



Variable 




r2 


2 
s 


r2 


2 

s 


r2 


T 
s 


SRE 


.346* 


.119 


.006 


.120 


.006 


.120 


.006 


PRE 


.265* 


.070 


.006 


.100 


.006 


.104 


.006 


GRE 


.374* 


.140 


.006 


.148 


.006 


.165 


.006 


WRE 


.430* 


.185 


.005 


.200 


.005 


.204 


.005 



*Significantly different from zero at the ct = .05 level. 



3, FT rating - This rating again illustrates that the WRE is the 
most promising estimator. In fact it is almost identical to the 
results obtained for the ET rating and the WRE. The product-moment 
correlation of .43 reflects a moderate degree of association with 
the criterion variable. The R^ value of near ,2 still illustrates 
a significant degree of unexplained criterion variance in the data. 
It Is again suggested that the linear model: 

TP score = 3.366 + 4.635 WRE 

be employed in this rating. The linear model fit is modest (R^ = .185) 
but the WRE possesses sufficient promise to be called a good esti- 
mator of FT technician proficiency. 
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TABLE n 

IC CURVILINEAR REGRESSION ANALYSES (N = 58) 



Type of Curve 



Predictor Linear Quadratic Cubic 



•lable 




r2 




r2 


s2 


r2 


s2 


SRE 


.361* 


.131 


.016 


.131 


.015 


.133 


.016 


PRE 


.322* 


.104 


.016 


.131 


.016 


.134 


.016 


GRE 


.387* 


.149 


.015 


.154 


.015 


.169 


.015 


WRE 


.434* 


.188 


.014 


.241 


.014 


.292 


.013 



♦Significantly different from zero at the a = .05 level. 



4. IC rating - Unfortunately the sample size (N = 58) for this rating 

is toj low to place confidence in the obtained correlation coefficient. 

However, the WRE must be selected as the most valid estimator on all 
counts. The cubic model 

TP score = -7.57 + 68.26 WRE - 113.95 WRE^ + 63.03 WRE^ 



1s suggested for use in this rating and is a moderate estimate of TP 
score. The residual mean square 1s high for this rating only because 
of the small sample size. In any event this rating reflects the 
general trend that we have been witnessing and, therefore, the WRE 
may be employed in this rating. 



TABLE 12 

RD CURVILINEAR REGRESSION AiALYSES (N = 139) 



Predictor 








Type of Curve 






Linear 


Quadratic 


Cubic 




Variable 


r 

xy 




s2 


r2 




r2 


s2 


SRE 


-.168 


.028 


.007 


.093 


.007 


.131 


.006 


PRE 


-.215* 


.045 


.007 


.046 


.007 


.093 


.007 


GRE 


.021 


.000 


.007 


.013 


.007 


.04' 


.007 


WRE 


-.051 


.003 


.007 


.021 


.007 


.041 


.007 



♦Significantly different from zero at the a = .05 level. 
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5, RD rating - None of the four estimators that have been dis- 
cussed 1n this report should be employed In the RD rating. In 
part the failure of the estimators In this case must be attributed 
to the significantly high frequency with which Individuals In 
this rating do not work at the job activities that were used on 
the evaluation forms. 



TABLE 13 

RM, ST, AND TM CURVILINEAR REGRESSION ANALYSES 



T ype of Curve 



Predictor 




Linear 


Quadratic 


Cubic 


VaHable 


r 

xy 


R^ 


c 

s~ 






r2 




RM Rating 


(N = 137) 














SRE 


.211* 


.044 


.007 


.057 


.007 


.068 


.007 


PRE 


.156 


.024 


.007 


.028 


.007 


.031 


.007 


GRE 


.041 


.002 


.007 


.140 


.006 


.139 


.006 


WRE 


.366* 


.134 


.006 


.153 


.006 


.154 


.006 


ST Rating 


{N = 152) 














SRE 


.199* 


.040 


.006 


.069 


.006 


.069 


.006 


PRE 


.058 


.003 


.007 


.003 


.007 


.102 


.006 


GRE 


.099 


.010 


.007 


.134 


.006 


.178 


.006 


WRE 


,234* 


.055 


.006 


.080 


.006 


.123 


.006 


TM Rating 


(N = 39} 














SRE 


.198 


.039 


.026 


.129 


.024 


.217 


.022 


PRE 


.243 


.059 


,025 


.094 


,025 


.153 


.024 


GRE 


.186 


.035 


.026 


.035 


.027 


.085 


.026 


WRE 


.403* 


.162 


.023 


.177 


.023 


.224 


.022 


*S1gn1f1cantly different from 


1 zero 


at the o 


= .05 


level . 
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6. Rating RM. ST, and TM - The results for these ratings are almost 
Identical and can be discussed as a group. In every case the WRE 
1s the best estimator of TP score. The product-moment correlations 
are low for the RM and ST ratings, and moderate for TM's. All of the 
R2 values demonstrate a poor fit to the data, Indicating an even 
higher degree of unexplained criterion variance than that found in 
the EM, ET, FT, and IC ratings. It is reconmended that the cubic 
curve be employed in the ST and TM rating and a linear curve for 
the RM rating. The corresponding equations may be found from the 
computer printout of the curvilinear regression for those ratings 
(pages 1-26, 1-30, and 1-34 respectively). However, the utility 
of their use as prediction instruments has not been convincingly 
demonstrated. 



4' 

Technician Job Competency Evaluation 



As hypothesized in the discussion on the validity of the performance estimators 
SRE, PRE, GRE, and WRE, the TPCF could be employed as a criterion measure of the ab- 
solute proficiency level of electronics maintenance personnel. That the TPCF pos- 
sesses that characteristic was evaluated by Siege! and Fischl [17] for avionics 
technicians and at that time the TPCF possessed a substantial degree of promise. 
Siegel and Federman [16] applied the TPCF when appraising the proficiency level of 
electronics maintenance personnel and in evaluating the SRE, PRE, and GRE. 



Due to the high degree 
to investigate the TPCF and 
the data collected in this 
for present-day electronic 
more, are the job tasks lis 
While it may not be possibl 
to give at least a partial 
the properties of the TPCF 
in each rating and determin 
proficiency level . 

Job Task Analyses 

The reader will recall that the job tasks listed on the TPCF are ordered with Job 
Task No. 1 being the easiest and Job Task No. 8 the most difficult. The following is 
a list of the job tasks as found on the TPCF: 



of reliance on the TPCF as 
consider whether some of i 
project. The appropriatene 
maintenance activities can 
ted in the same hierarchial 
e to completely answer ques 
answer based on the present 
it Is possible to develop a 
e whether a particular rati 



a criterion measure, it is well 
ts properties seem to hold up for 
ss of the job tasks on the TPCF 
be considered, by rating. Further- 
order as when originally developed? 
tions of this type, it is possible 
format of the TPCF. By using 
competency level for technicians 
ng may be performing at a certain 



Task Description 
(easiest) . Capable of employing safety precautions . 

ul. Capable of replacing most of unit's equipment. 

3. Capable of removing most of unit's equipment. 

4. Capable of following block diagrams . 

5. Capable of knowing relationship of equipment to other 
related equipment . 
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€• Capable of calibrating most of unit's equipment. 



7. Capable of t rouble-shooting/ isolated mal function (s) > 

(most 8, Capable of employing electronic principles involved in 

difficult) maintenance. 

Table 14 is the frequency of occurrence of men CHECKED OUT and NOT CHECKED OUT by 
rating over the eight job tasks without reference to their performance on other job tasks. 
For example, of the 97 men in the EM rating, 95 were CHECKED OUT on Job Task No, 1, 87 

were CHECKED OUT on Job Task No. 2 and 55 were CHECKED OUT on Job Task No. 8. 

Similarly, for the other ratings. 

From Table 14 the hierarchial difficulty of tasks is generally represented in the 
EM, ET, FT, IC, ST, and TM ratings. This is evidenced by the fact that one would expect 
progressively fewer men to complete a more difficult task. Except for the ST rating. 
Job Task No. 6 - Capable of calibrating most of this unites equipment with which his 
rating is concerned - seems out of place in that fewer individuals are CHECKED OUT on 
this task than the next more difficult task, Job Task No. 7. In fact the better position 
for Job Task No. 6 would be after Job Task No» 8. In that case the job tasks would fol- 
low more closely a hierarchial classification. ^ 

In any event it can be said that Job Task No. 6 is no longer of such prominence as 
originally thought. This is a result of the introduction of more sophisticated elec- 
tronic equipment aboard ships in recent years. This equipment frequently consists of 
integrated circuitry and compact electronic modules requiring little if any calibration. 
Furthermore, test instrumentation calibration is also In demise because less test equip- 
ment is being employed. Normally a defective component is replaced en toto without 
regard aboard ship for finding the particular fault in the component. Those functions 
are beyond normal shipboard electronic maintenance activities. 

In the RD rating thert: are a significant number of individuals NOT CHECKED OUT on 
many of the tasks. This is probably due more to a nonappHcability of those tasks to 
that rating than to a lack of sufficient training. This is to a degree verified by the 
findings in Appendix E where it was demonstrated that for most job activities there are 
a very high proportion of individuals in that rating who either do not work at the job 
activities or received SUE = 0 and Sul = 0 from their supervisor. It is possible that 
the nonapplicability of many of the tai:ks to the RD rating did give erroneous TP scores 
for this rating and depressed the validity coefficients (see Table 12). A more detailed 
study than the present one would be requ^!red to come to a definite conclusion on this 
issue. 

As shown in Table 14 and the RM rating. Job Tasks 2 and 4 are not in agreement with 
the underlying order of job tasks, but Job Task No. 6 is in a proper position for this 
rating. It seems that a reordering of the first five job tasks on the TPCF would allow 
this instrument to be more applicable to this rating. It would probably require a 
minor research effort to revise the tasks in the RM rating. 



It is important to note that none of the conclusions of previous sections would be 
altered with this modification because the TP score (or TPC level) is independent of the 
hierarchial classification. Those variables are dependent only upon the number of job 
tasks an individual was CHECKED OUT on, and not upon the order of the CHECKED OUT tasks. 
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TABLE 14 
JOB TASK ANALYSES 



£M Frtquenclej (N • 97) 



Job Task V,o. 


1 


2 


3 


4 




5 


6 


7 


8 


Checked Out 


95 


87 


87 


77 




75 


43 


63 


55 


Not Checked Out* 


2 


TO 


)0 


20 




22 


54 


34 


42 






ET Frequencies 


(N • 












Job T<sk No. 


\ 


2 


3 


4 




5 


6 


7 


B 


Checked Out 


166 


147 


164 


U5 




12'6 


96 


129 


132 


Not Checked Out 


5 


26 


9 


8 




47 


77 


44 


41 






FT Frequencies 


(N - 


154) 










Job Task No. 


1 


2 


3 


4 




5 


6 


7 


8 


Checked Out 


148 


125 


134 


143 




116 


93 


100 


102 


Not Checked Out 


6 


29 


20 


n 




38 


61 


54 


52 






IC 


Frequencies 


(N - 


58) 










Job Task No. 


1 


2 


3 


4 




5 


6 


7 


8 


Checked Out 




45 


A9 


44 




41 


26 


33 


27 


Not Checked Out 


i 


13 


9 


14 




17 


32 


25 


31 






RD Frequencies 


CM - 


139) 










Job Task No. 




2 


3 


4 




5 


6 


7 


8 


Checked Out 


136 


27 


38 


50 




97 


B 


8 


26 


Not Checked Out 


3 


112 


101 


89 




42 


131 


131 


113 






RH Frequencies 


(N «" 


137) 










Job Task No. 


1 


2 


3 


4 




5 


6 


7 


B 


Checked Out 


135 


88 


100 


88 




113 


46 


27 


13 


Not Checked Out 


2 


49 


37 


49 




24 


91 


110 


124 






ST Frequencies 


(N - 


i5;o 










Job Task No. 


1 


2 


3 


4 




5 


6 


7 


8 


Checked Out 


U4 


118 


119 


117 


121 


103 


77 


80 


Not Checked Out 


8 


34 


33 


35 




31 


49 


75 


72 






TM Frequencies 


|N » 


39) 










Job Task No. 


1 


2 


3 


4 




5 


6 


7 


B 


Checked Out 


38 


31 


32 


31 




34 


14 


18 


8 


Not Checked Out 


1 


e 


7 


8 




S 


25 


21 


31 



*The reader 1s cautioned that a score of NOT CHECKED OUT on a task does not dif- 
ferentiate between whether a technician really cannot be trusted with doing the task 
on his own without direct supervision or whether he was given a score of NOT CHECKED 
OUT because he does not work at that task. 
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Conditional Frequencies for Job Tasks 



Appendix J provides tables of a more detailed analysis of some observations on the 
TPCF. In particular the Job Task Conditional Frequency is given by rating; i.e., for 
a given task, the number of individuals who were CHECKED OUT on each easier task given 
they were at most CHECKED OUT on the given task. Those tables should provide more In- 
sight into the hierarchial classification of the job tasks and also a relative level of 
technician competency by rating. 

To illustrate the use of the tables prepared In Appendix J, consider Table 15. This 
table represents the Job Task Conditional Frequencies for the EM rating as can be found 
in Appendix J, page J-4. 



TABLE 15 



EM RATING CONDITIONAL FREQUENCIES {N = 97) 



Job Task 



6 


5 


4 


3 


2 


1 


33 


50 


50 


50 


52 


55 


4 


13 


14 


17 


17 


17 


6 


6 


5 


5 


4 


6 




6 


S 


6 


6 


6 






3 


3 


3 


3 








6 


5 


6 










0 


0 












2 



The number of men that were not checked out on any job 
task is 2. 



From the first row of Table 15, 55 of the 97 EM'S were CHECKED OUT at most on 
Job Task No. 8. Of those 55 me n, 46 were also CHECKED OUT on Job Task No. 7 (the next 
easier task), 33 were CHECKED (JUT on Job Task No. 5, and finally all 55 men were 
CHECKED OUT on Job Task No. 1 (the easiest task). Continuing, from the second row of 
the Conditional Frequency table, 17 of the 97 EM's were CHECKED OUT at most on Job 
Task No. 7 (i.e., none of those 17 men were CHECKED OUT on Job Task No. 8)7 Again, 
of those 17 men, 4, 13, 14, 17, 17, and 17 were also CHECKED OUT on Job Task No.'s 
6, 5, 4, 3, 2, and 1 respectively. Finally, only 2 men were CHECKED OUT on Job Task 
No. 1, i.e.t none of those 2 men were CHECKED OUT on a more difficult task. Also, 
there were 2 men in the EM rating that were not CHECKED OUT on any of the eight tasks. 
Clearly then one would expect any row of a Conditional Frequency table to contain al- 
most Identical entries, i.e.* if the job tasks are truly hierarchial and representative 
of tasks in that rating. 
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Consider now Appendix J, page and the Conditional Frequeicy table. From the 
first two rows of that table, most of the EM's CHECKlO OUT at mosi on Job Tasks 7 and 
8 were also able to complete the easier tasks, except for Job Task )'o. 6. Again, that 
task is very much out of place in the order of job tasks, Ihe^d is e low degree of in- 
competence present for 13 percent of the EM's could be CHECKED OUT 2it most on no more 
than Job Task No, 4. However» it must be realized that this result could also be due 
to the possibility that many of those individuals simply do not work at a more difficult 
task than Job Task No. 4. 

The ET, FT, ST, and TM ratings (Appendix J, pages J-5, J>6, J-10, and J-11 respec- 
tively) demonstrate practically the same results for the Conditional Frequency tables 
as the EM's. For those ratings 8, 10, 9, and 13 percent were CHECKED OUT at most on no 
more than Job Task No. 4 respectively. The IC, RD, and RM ratings demonstrated 21, 30, 
and 17 percent. These remarks illustrate the practicality of the TPCF as an instrument 
for evaluating the competency level of particular ratings and for isolating those job 
tasks requiring further training by electronic maintenance technicians. 

It is to be noted that as In the EM rating, Job Task No. 6 is inconsistent in most 
of the other ratings with respect to its proper order in the eigyt job tasks. 

Joint Frequencies for Job Tasks 

Appendix J also provides the Job Task Joint Frequencies by rat'^ng. For each rating 
this is the number of individuals who were CHECKED OUT on any two given tasks. Use of 
the Joint Frequency tables is illustrated by Table 16. 



TABLE 16 



EM RATING JOINT FREQUENCIES (N = 97) 



1 


2 


3 


4 


5 


6 


7 


8 


95 


87 


87 


77 


75 


43 


63 


55 




87 


84 


73 


70 


40 


63 


52 






87 


71 


69 


40 


62 


50 








77 


69 


40 


56 


50 










75 


42 


56 


50 












43 


35 


33 














63 


46 
















55 



From the first row of Table 16, 95 of the 97 EM*s were CHECKED OUT on Job Task No. 
1, 87 (of the 97 EM's) were CHECKED OUT on both Job Task No.'s 1 and 2, 87 were CHECKED 
GUT on Job Task No.'s 1 and 3, .... and 55 (Of the 97 EM's) were CHECKED OUT on Job 
Task No.'s 1 and 8. Similarly, from row 2 of the Joint Frequency table, 87 (of the 97 
EM's) were CHECKED OUT on Job Task No. 2, while 84, 73, 70, 40, 63, and 52 (of the 97 
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EM's) were CHECKED OUT on both Job Task No. 2 and Job Task No. 3, 4, 5» 6, 7, and 8 
respectively. It 1s well to note that the diagonal entries of this table corresponds 
exactly to the frequency entries for the CHECKED OUT case given In Table 14. 

Just as In Table 15 on the Conditional Frequencies one would e^^pect that any row of 
that table to have almost Identical frequencies* In a Joint Frequency table one would 
expect any column to contain Identical frequencies. For example, completion of Job Task 
No. 5 should also Insure completion of Job Tasks 1, 2, 3, and 4. Likewise, the rows of 
the Joint Frequency tables should Illustrate decreasing frequencies for being CHECKED 
OUT on a task does not insure being CHECKED OUT on a more difficult task. 

From the Joint Frequency tables (Appendix J, pages 0-4, J-5, J-6, J-7j and J-11) 
for the EM, ET, FT, IC, and TM ratings respectively, the previously mentioned patterns 
that are Illustrated by a Joint Frequency table are demonstrated except for Job Task 
No. 6. This Is consistent with the analysis on the Conditional Frequency tables. The 
ST rating conforms almost exactly to the expected patterns for a Joint Frequency table. 
Unfortunately there are a few Instances In which the Conditional Frequency table for that 
rating deviates from the expected pattern. In any event the task descriptions on the 
TPCF are very descriptive of the ST rating job tasks. 

The RD rating Joint Frequencies (page J-8) illustrate the general lack of patterns 
characteristic of a Joint Frequency table. The RM rating Joint Frequencies (page J-9) 
more closely conform to the desired patterns but still leave something to be desired. 



Multiple Comparisons of Ships and Ratings 



From either a research or applied point of view it Is often necessary to compare the 
performance levels of various ships or ratings. Such comparisons may be employed to com- 
pare ships (or ratings) relative to mean performance levels. However, such comparisons 
can also offer a basis upon which to formulate a decision as to whether a particular 
ship configuration of men and/or equipment is, or is not, detrimental to ship/rating 
performance. In a similar fashion, policy making decisions also can be evaluated with 
respect to their Influence on the performance of ships or ratings affected by that policy. 

In this section the main subject of concern will be the development and justification 
of a technique fc^* performing pairwise comparisons between ratings and between ships on 
the basis of mear performance levels with respect to some variable. The variables to be 
considered are the SRE, PRE, GRE, WRE, and the selected criterion variable TP score. In 
general this subject falls under the area of multiple comparisons arising from an Analysis 
of Variance (AOV) of ship/rating effects. The particular model to be considered will 
be a two-way fixed effects design with an unequal number of observations for the ship/rating 



'^It is assumed that each observation y^^k °" Individual in the 1^" ship v:^ 

the jtn rating Is due to an overal? effect (y7» a ship effect (ot^), and a rating effect 

Furthermore, a general mode'i addresses the question of the existence of significant 
row-column Interaction (6^) upon each observation. In particular this report addresses 
the additive model of the form 

^Ijk = y + + ej + + e.j,^ 

where e^j|^ Is an error tern associated with the above model. In this situation it is a 
two-way nxed effects design with an unequal number of observations in the l-j^^ cell. 
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combinations (see Table 1). Choice of this model requires the verification of normality 
of the selected performance variable over the main effects, homogeneity of the variances 
of the main effects and Independence across and between the main effects.'' The main 
effects are "ships" and "ratings." That performance variable to be selected for per- 
forming the multiple comparisons will, most naturally, be the one which best conforms 
to the requirements for use of the model being considered and is most associated with 
technician on-the-job performance. 

Distributional Properties of the Performance Estimators 

The g-j test statistic for normality was applied to the distribution of SRE, PRE, GRE, 
and WRE values for the 949 technicians in the sample (combined locations). Table 17 il- 
lustrates the results of this analysis. 



TABLE 17 



91 TEST STATISTIC VALUES FOR THE PERFORMANCE ESTIMATORS 





SRE 


PRE 


GRE 


WRE 




.5807 


-.4565 


-4.7092 


.7939 


Z 


7.3265 


-5.7599 


-59.4129 


-.5823* 



*Because WRE scores (Figure 4) are almost normally dis- 
tributed, a test statistic [4] similar to the g-. test 
statistic but more sensitive to departures from normality 
due to kurtosis was applied to the WRE scores. 



Recall that rejection of normality results if | 2 | >_1.96. 

Clearly then the only estimator which appears to be normally distributed is the 
WRE. This same analysis was appliied by location and rating with practically the same 
results. In each case only WRE scores proved to be normally distributed, except for 
isolated incidents of the other estimators. This characteristic of WRE scores is not 
surprising as this situation is essentially an application of the Central Limit Theorem 
as found in probability theory, sae [12]. The lack of normality on the part of the 
other estimators is not necessarily c.n undesirable feature, but it is true that this 
exercise does point out yet one more desirable feature of the WRE, namely, its general 
normality. 

Choice of a Variable 

As previously noted it is necessary to choose an appropriate variable upon which 
to base the multiple comparisons of ships and ratings. From the previous section - 
Distributional Properties of the Performance Estimators - it was observed that WRE 
scores possessed the unique characteristic among the performance variables (SRE, PRE, 
GRE, and TP score) of being normally distributed. This characteristic of WRE scores is 
most helpful particularly since homogeneity of variances in the ships, ratings, and 



''A search of the literature failed to locate a particular test to employ for 
independence in the case of unequal numbers for the ship/rating combinations. See 
Anderson [1] for the case of equal numbers. 



An identical AOV was executed as above but for the four ratings (EM, ET, FT, and 
IC) for which the performance measurement technique was most promising. Table 19 re- 
flects the results of this AOV. 

TABLE 19 



AN ANALYSIS 


OF VARIANCE FOR 21 


SHIPS AND 4 


RATINGS 




Source 


Degrees of 
Freedom 


Sum of 
Squares 


Hear 
Squore 


F Value 


Total 


482 


192.0419 






Between Ships 


20 


2.669 


.1334 


3.884* 


Between Rating 


3 


.5621 


.1874 


5.4598* 


Ship by Rating Interaction 


60 


4.0437 


.0674 


2.2975* 


Residual 


398 


11 .6747 


.0294 





*Indicates significance at the a = .05 level. 



In either of the above tv/o AOV tables there exists significant ship/rating inter- 
action. This situation will not permit the comparing of any two of the main effects 
under a two-way design because of the confounding of the main effects with the inter- 
action terms. The only recourse is to test for significant differences in each ship, 
across ratings, or in each rating, across ships. If the interaction terms were not 
significant, it would be an easy matter to compare ratings and to compare ships by em- 
ploying the entire set o-^"" data represented in the AOV's of Table 18 or Table 19, see 
agaifi Scheffe [15]. 

Testing for Significant Shjp (Rating) Effects for a Particular Rating (Ship) 

In order to develop comparisons between ships (for a fixed rating) and to develOD 
comparisons between ratings (for a fixed ship), this report will employ an AOV moder^ 
resulting from a one-way fixed effects design with unequal numbers of observations 
across the main effects. Homogeneity of the variances across the main effects must be 
assumed in this case for the usual tests are large sample tests and inapplicable for 
ship/rating numbers less than ten (see Layard [14] and Table 1). 

For present purposes only the AOV's, and subsequent multiple comparisons, will be 
developed on ihe 21 ships participating in the project and the four ratings EM, ET, FT, 
and IC. This will involve 25 different AOV's to be constructed and subsequently de- 
veloped for multiple comparison of the main effects if the AOV indicates significant 
main effects . 



"'^This report will employ a model of the form 

Y-ijf^ = p + a^- + e^jl^ (j is fixed and i = l, 21) 

for testing for significant ship effects, and a mode'' of the form 

^ijk ^ ^ijk fi>(^ed and j=l , .... 4) 

for testing for significant rating effects. The subscript k is an index representing 
the k^'^ man in that main effect. 
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Initally the hypothesis of equality of mean WRE scores was tested for the four 
ratings EM ,ET, FT, and IC for each of the 21 ships. This hypothesis was accepted 
for 12 of the 21 ships. On the remaining 9 ships Scheffe's multiple comparison 
technique was applied in searching for a possible significant difference between any 
two {of the four) ratings on the basis of mean WRE scores. Table 20 reflects the re- 
suits of these multiple rromparisons, each derived from a separate Analysis of Variance. 
(The resulting 21 AOV tables are too extensive to be presented in this report). 

Finally the hypothesis of equality of mean WRE scores was tested for the 21 ships 
for each of the four ratings EM, ET, FT, and IC. This hypothesis was rejected for each 
of the four ratings. No significant differences were found between any pair of the 
ratings using Scheffe's multiple comparison technique. This is not an inconsistent 
result, for this could be a result of trying to perform too many multiple comparisons 
(therefore, increasing the comparison error rate) and/or the effect referenced in the 
footnote of Table 20. 



TABLE 20 



MULTIPLE 


COMPARISON OF 


FOUR RATINGS ON 


NINE SHIPS* 


Ship 


Highest 
Mean WRE 






Lowest 
Mean WRE 


a 


EM 


FT 


ET 


IC 


b 


FT 


ET 


EM 


IC 


c 


EM 


ET 


IC 


FT 


d 


ET 


FT 


EM 


IC 


e 


IC 


EM 


ET 


FT** 


f 


IC 


ET 


FT 


EM** 


9 


FT 


IC 


EM 


ET 


h 


EM 


ET 


IC 




i 


EM 


ET 


FT 





*For each ship a line under two ratings sig'-.ifies no 
significant difference between the ratings. 



**It is important to note that while no differences 
in rating means were detected, the rejection of the null 
hypothesis of the equality of rating means is not in 
error. This only implies that some contrast other than 
those contrasts testing rating differences lead to that 
rejection, see Ferguson [8, pp. 279-283]. 
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Association Between Demographic and Performance Variables 



Usually it is of interest from either a research or applied point of view to esti- 
mate school success, final grade, etc* of an individual in some training program or 
school by employing such predictor variables as the Basic Test Battery (bTB) scores - GCT, 
ARI, MECH, and CLER scores or combinations of those scores. Typically BTB scores are 
used to predict actual school success which in turn is viewed as being the best available 
measure of potential job success. Seldom, however, are direct measures of on-the-job 
performance available as those developed in the current studv. Accordingly the relation- 
ship between the BTB scores - GCT, ARI, and Skill (GCT + ARl) - and measures of on-the-job 
performance - SRE, PRE, GRF, WRE, and TP score - was investigated. 

Besides tfie BTB scores, other available predictor, variables were also considered 
under the general heading of demographic variables. In this report the demographic 
variables to be considered are: months known by supervisor, months on current job 
assignment, GCT score, ARI score, SKILL (GCT + ARI) score, and A, B, and C school final 
grade. The performance variables that will be employed to relate to on-the-job technician 
performance are the eight reliability ratios relative to the job activity factors on the 
JPQ ANSWER SHEET, and the variables SRE, PRE, GRE, WRE, and TP score. 

Utility of Demographic Variables in Perfonnance Prediction 

In order to determine the utility or effectiveness of the demographic variables 
previously introduced to relate or be associated with on-the-job technician performance, 
product-moment correlation coefficients were developed between those demographic vari- 
ables and the performance variables. From this analysis it is possible to infer the 
extent which the demographic variables may be viewed as linear predictors of the demo- 
graphic variables. 

Demographic Variable Prediction on Combined Locations 

Tc.b-e 21 reflects the product-moment correlation coefficients that resulted when 
the 949 technicians were considered. In that table there are many product-moment cor- 
relation coefficients significantly different from zero, but they are of such low 
magnitude. Now from a li near prediction standpoint, the multiple correlation coefficient 
(R^) is related to the product-moment correlation coefficient (Tv^w) by R2 - (x 
is one of the demographic variables and y is a performance variable.) Therefore, from 
Table 21, even for the largest r ^ value observed, namely 0.217, the R^ value for 
this case is still a very low 0.64? for the degree of fit of the linear model to the 
data (x is SKILL score and y is TP score). However, even with the low correlations 
represented by the BTB scores, those scores do offer some hope of predicting on-the-job 
performance as measured by the TPCF. The correlation coefficients reflect the degree 
of association that is typically found between predictor variables and on-the-job 
performance. However, these results show considerable promise for further research in 
the area of the development of on-the-job performance measures. 

Demographic Variable Prediction in the EM, ET, FT. and IC Ratings 

In a similar manner product-moment correlation coefficients were developed between 
the demographic and performance variables for the technicians sampled from the four 
more promising ratings EM, ET, FT, and IC. In Table 22 are the results of this analysis. 
From this table the same observations as above can be made for this case since no pro- 
duct-moment correlation is greater than 0.217, the largest previously observed. Also, 
as in the above, some hope is offered by BTB scores for predicting on-the-job performance 
as measured by the TPCF. The correlation coefficients, though suppressed, are still of 
sufficient msc^nitude to warrant some promise for further research. 



Excluding B school final score which has such a low sample size represented. 
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TABLE 21 

DEMOGRAPHIC CORRELATIONS ON EIGHT RATINGS 



ReliabiHty Ratios 







KCT 


Equip 


Cir 


Pers 


L 1 cC 




C 1 a/* 

c 1 ec 


£1 ec 




H 


Mat 


Op 


Anal 


Rel 


Safe 


Inst 


Rep 


Cog 


Mo known by super 


948 


0.032 


0.068* 


-0.006 


-0.020 


0.038 


0.001 


-0.069* 


-0.036 


Mo on current assign 


948 


0.029 


0.106* 


-0.005 


-0.034 


0.057 


-0.013 


0.012 


-0.009 


GCT scores 


909 


-0.027 


-O.Ci4 


-0.048 


-0.078* 


-0.014 


-0.096* 


-0.050 


-0.076* 


ARI score'; 


909 


0.018 


-0.014 


-0.030 


-0.066* 


-0.031 


-0.076* 


-0.039 


-0.022 


SKILL scores 


909 


-0.006 


-0.029 


-0.046 


-0.095* 


-0.027 


-0.100* 


-0.052 


-0.057 


A school final grade 


774 


0.039* 


0.090* 


0.046 


0.038 


0.017 


0.082* 


0.104* 


0.101* 


e school final grade 


16 


-0.022 


0.379 


0.227 


0.231 


0.178 


0.323 


-0.044 


0.300 


C school final grade 


254 


0.016 


0.077 


0.006 


0.000 


^0.054 


-0.009 


0.119 


0.079 








Perfomance Estimators 












N 


SRE 


PRE 


GRE 


VIRE 


TP Score 








Mo known by super 


948 


-0.029 


-0.038 


0.055 


0.011 


0.086* 








Mo on current assign 


948 


0.067* 


0.036 


0.044 


0.070* 


0.191* 








GCT scores 


909 


-0.119* 


-0.100* 


-0.040 


0.018 


0.186* 








ARI scores 


909 


-0.076* 


-0.066* 


-0.013 


0.037 


0.193* 








SKILL scores 


909 


-0.111* 


-0.095* 


-0.034 


0.032 


0.217* 








A school final grade 


774 


0.142* 


0.096* 


0.084* 


0.096* 


0.070* 








B school final grade 


16 


0.339 


0.387 


0.167 


0.265 


-0.173 








C school final grade 


264 


0.041 


0.027 


0.047 


0.092 


0.091 









♦significantly different from zero at the a = .05 level. 
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TABLE 22 

DEMOGRAPHIC CORRELmT:0NS ON FOUR RATINGS 



Rel'aLility Patios 





N 


Ref 


Equip 


Cir 


Pers 


ElGC 




Elec 


Elec 




Mat 


Op 


Anal 


Rel 


Safe 


Inst 


Rep 


Cog 


Mo known by super 


481 


-0.043 


-0.021 


-0.097* 


-0.055 


0.025 


-0.C85 


-O.062 


-0.084 


Mo on current assign 


482 


-0.035 


0.093* 


-0.034 


-0.C44 


0.064 


0.032 


o.oai 


-0.019 


GCT scores 


459 


-0.045 


-0.001 


0.026 


-0.072 


-0,047 


-0.013 


0.008 


-0.007 


ARl scores 


459 


-0.002 


0.014 


0.026 


-0.094* 


-0,035 


0.UG6 


-0.008 


0.032 


SKILL scores 


459 


-0.026 


0.007 


0.030 


-0.093* 


-0,046 


-0.003 


0.001 


0.014 


A school final grade 


323 


0.086 


0.107* 


0.047 


0.009 


0.057 


0.063 


0.057 


0.C8S 


B school final grade 


10 


-0.342 


0.322 


0.103 


0.129 


-0.201 


0.328 


-0.225 


0.250 


C school final grade 


164 


0.C04 


0.051 


-0.057 


0.016 


-0.103 


-0.097 


-0.018 


0.0S5 








PerfoHMancG Estimators 












N 


SRE 


PRE 


gr: 




TP Score 








Mo known by rater 


481 


-0.083 


-0.096* 


-0.005 


-0.C40 


0.089* 








Mo on current assign 


482 


0.017 


0.014 


COBS* 


0.062 


0.214* 








GCT scores 


459 


-0.050 


-0.081 


0.008 


0.055 


0.172* 








ARI scores 


459 


-0.033 


-0.056 


0.016 


0.G4B 


0.1^14* 








SKILL scores 


459 


-0.0't/ 


-0.077 


0.014 


0.054 


0.173* 








A school final grade 


383 


0.071 


0.049 


0.112* 


0.125* 


0.167* 








B school final grade 


10 


0.02a 


0.213 


-0.010 


0.027 


-0.265 








C school final grade 


164 


-0.003 


-0.0^.5 


-0.019 


0.080 


0.135 









♦Significantly different from zero at the a = .05 level. 
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SUMMARY AND CONCLUSIONS 



Su mmary of Da t a Analyses 



Evaluation of the Performanc e Estimators 

When evaluating a performance estimator it is initially of interest to consider the 
degree to which that estimator c-3C in fact measure an individual's on-the-job perform- 
ance. In order to address this particular aspect of the analyses it was necessary to 
choose an appropriate criterion measure of on-the-job performance. The variable selected 
as the criterion measure in this report was Technical Proficiency 'TP) score (or Tech- 
nical Proficiency Checkout (TPC) level) as derived from the Technical Proficiency Check- 
out Form (TPCF). Prio>" research efforts denonstrated that this variable was a viable 
criterion variable. Initially triserial correlation coefficients were developed between 
the TPC level and each of the performance estimators (SRE, PRE, GRE, and WRE) being 
evaluated. Essentially due to the lack of normality of the continuous variable TP score, 
triserial correlation liad to be considered inappropriate for the data collected in the 
course of this project. Finally a curvilinear regression analysis was executed between 
each of the performance estimators and TP score with an emphasis upon a least-squares 
interpretation of the corresponding results. 

When the entire sample of 949 technicians was considered, relatively low multiple 
correlation coefficients corresponding r.o a linear, quadratic, and cubic model were 
obtained. Furthermore, low product-moment correlation coefficients were obtained for 
some estimators. Due to these results it was decided that a more appropriate approach 
to analyzing the data would be an analysis by rating. That is also a more appropriate 
approach for job tasks or j«jb activities would be more homogeneous within a particular 
rating. 

When the individual ratings were considered it could be concluded that of the four 
perfornance estimators - SRE, PPL. GRE, and WRE - the WRE possesses the greatest degree 
of promise in al'' ratings. The o-^ly exceptions occur for the ET and RD ratings in which 
the GRE is slightly better and none of the estimators apply, respectively. The WRE is a 
moderate estimate of absoiute technician performanT^*. in the EM, ET, FT, and IC ratings 
and a modest estimate of absolUwe performance in the RM, ST, and TM ratings. It is recom- 
mended tr.:.t the WRE be applied, in particular, upon the EM, ET, FT, and IC ratings for 
purposes of comparing individuals or groups of individuals in those ratings. In fact, 
it is suggested that in most analyses where the performance of an individual, or group 
of individuals in those ratings is needed, (i.e., an estimate of the probability of ef- 
fective performance is required) that the WRE be employed. Usually these analyses would 
involve a classification or discr^n* l.idtion of such individuals on th^i basis of their 
present-day on-the-job performance. However, use of the WRE in the RM, ST, and TM ratings 
is not as justified and, thccsfort.-, if used in those ratings, it should be only with utmost 
caution with regard to its low ^'^'idity, as determined by the TPCF. 

The Criterion Measure of On-the-Job Performance 

Because the TPCF was employed as a criterion measure of technician on-the-job 
performance, an analysis of the extent to which its properties were verified by the 
data collected in this project was considered. To achieve this end Conditionc;! and 
Joint Frequency tables were developed by rating to determine whether the hierarchial 
classification of the job tasks was in effect and whether the job tasks were appropriate 
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to present-day electronic maintenance activities. Results from those tables revealed 
that only one job task - capable of calibrat ,ig most of this unit's ecuipment with w'.nch 
his rating is concerned - was more dated than the other iob tasks. With this exception 
the job tasks seemed to follow a hierarchial classifica; on in all but the RM rating, 
and to a lesser degree in the RD rating. From these analyses it is suggested that the 
following alterations be completed by a potential user before the TPCF is erriployed either 
in an operation* or research context: 

1. An updating of the job task descriptions by rating . It is not 
likely that a li'-t of task descriptions can be developed that are 
characteristic of the population of electronics maintenance person- 
nel without being too general and not specific enough for their 
intended use in any rating. 

2. A verification of the hierarchial classification of the up- 
dated task descriptions by rating . 

3. Revision of the TPCF to include an answer column that would 
reflect whether the technician actually works at the task descrip- 
tion being considered. 

4. Development of alternative test statistics that would reflect 
the hierarchial classification of the job tasks wh'ch TP score does 
not do. Suggested random variables to consider ar^: 

X = the highest job task the technician is CfiECKED OUT 
on, or 

Y = (X + TP score )/2. 

Use of X in a rating is most warranted if the hierarchial clas- 
sification is correct; if not, use of Y will "average" the effects 
of X and TP score. 

5. A validation by rating that the TPCF is highly predictive of 
on-the-job performance for that rating. 

In conclusion it can be said that the TPCF represents the most promising of the 
performance instruments evaluated. It is certainly the most easily administered and 
offers the least amount of confusion to the evaluator. Furthermore, the possibility 
of deriving competen^ty levels from the Conditional Frequency tables offers an alter- 
native procedure for comparing ratings or groups of technicians within a rating on the 
basis of the proportion of Individuals CHECKED OUT at most on a certain ta.^k. Although 
such comparisons v/ere not attempted in this report, it certainly is an appropriate topic 
for future research on the TPCF. 

Comparisons Between Ships and Ratings 

Multiple comparisons between r< tings and bei.ween ships was accomplished in this 
report by means of appropriate fixed-effect additive Analysis of Variance (AOV) models* 
Use of these models required the homogeneity of variances across the main effects (ships 
and/or ratings), normality of the variable upon which the comparisons are to be based, 
and independence of the observations across ships and ratings. The performance variable 
selected, from among SRE, PRE> GRE, WT.il, and TP score, was that one which best conformed 
to the above requirements and could be most associated with technician on-the-job per- 
formance. Initially this involved the investigation of the distributional properties 
of each of the performance variables. The distributions of the variables SRE, PRE, GRE, 
and TP score were all shown to be non-nomal for the subpopulations considered. This 
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charactaristic of those variables is only detrimental in AOV analyses for the case of 
unequal number of observations for the ship-rating combinations, which was the case for 
th3 data collected in this report (see Table 1). Essentially the difficulty arises 
when one attempts to apply a test of homogeneity of variances for the variable considered. 
The standard tests for homogeneity of variance require normality of the variable con- 
sidered. 

Only the variable WRE could be termed nornally distributed for all the subpopula- 
tions considered Furthermore, it was shown to be the most promising type of perform- 
ance estimator, particularly in the EM, ET, R, and IC rating. In view of these and 
other related considerations it was the most optimal choice of a performance variable 
upon which to base the multiple comparisons. Unfortunately, not all the requirements 
for use of the AOV models to be employed were satisfied by the WRE, however, the 
techniques employed to that end demonstrate the procedures that one should go throug;; 
in order to validly apply the AOV models. 

Initially a two-way fixed effects design was applied to the data. However, be- 
cause significant interaction was found to exist between ships and ratings, this 
necessarily forced multiple comparisions between ships (ratings) to be performed for 
a fixed rating (ship). Twenty-five AOV's were executed in that event in order to detect 
significant mean WRI£ scores between the four more promising ratings (EM, ET, FT, and IC) 
for each of the 21 ships in -he project and between the 21 ships for each of these four 
ratings. No particular pattern seemed to emerge across ships as to which rating is 
more proficient (in terms of m'^sn WRE scores). Furthermore, no pairwise significant 
difference was detected betwe: ^ny two ships (for any of the four ratings). 

In conclusion it would se£i.i. "^Mat the WRE is the most appropriate performance 
variable upon which to base the multiple comparison of ships and ratings. However, it 
would be a valuable exercise for a user to also include the other candidate performance 
variables and choose that variable most appropriate to the characteristics of the data 
collected. Likewise, the application of the appropriate variable for particular snip- 
rating configurations may yield insignificant ship-rating interaction, thus eliminating 
some of the difficulties; encountered in this report. In particular it is the user's 
responsibility to test th^; requirements and various configurations before deciding on a 
particular technique for performing multiple comparisons. It is hoped that the pro- 
cedure employed in this report offers some guidelines to the potential user for ap- 
plication of the performance me^iiurement technique being researched. 

Analysis of Demographic Data 

In addition to the performance data collected on the TPCF and JPQ ANSWER SHEET, 
demographic data were collected by means of the Personnel Identification Information 
Form (PIIF). The demographic variables that were subsequently studied were: months 
known by rater, months on current job assignment, GCT and ARI scores, and A, B, and 
C school final grades, Product-mcnicnt correlation coefficients were developed between 
those variables and the SRE, PRE, 6RE, WRE, TP score and each of the eight job activity 
reliability ratios. Although the resulting correlations were low, some hope was offered 
by GCT and ARI scores for predicitng on-the-job performance as measured by TP scores . 
It is felt that further research in this area may reveal that Basic Test Battery scores 
have some utility for predicting job performance levels. 



Observations on the Use of Composite Reliability Values 



It will be observed that many of the analyses chosen for ana'yzing the data rest 
upon the particular characteristics observed in the data, e.g., distributional properties 
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of the data. This is a reasonable and preff rred procedure to follow in order to form 
an opinion based on the data collected. Howevar, there was one necessary, and arti- 
ficial, revision of the fundamental characteristics of the original data that was re- 
quired in order to arrive at a numeric estiii.ate of performance based on the estimators 
SRE, PRE, 6RE, and WRE, That revision, of cL^urse, involved the adoption of a con- 
vention to estimate technician performance for those cases in which the technician 
either does not work at a job activity or re':eived SUE = ZUI = 0. The choice of a 
composite reliability value (Appendix F) to estimate technician performance in those 
cases cannot be viewed as the most optimal choice. However, it is certainly a reason- 
able and efficient means of employing the original data in order to ach;^ive peri'orm- 
ance estimates in those cases. Reasonable in the sense that this estimate is derived 
as the individual job activity reliability ratios are derived, i.e., by totaling the 
number of UE's and UI's observed and forming the ratio ZUE/[IUE + lUI]. Therefore, 
it should be no less objectional than are the reliability ratios. Furthermore, it is 
efficient in the sense that no complicated mathematical procedure is required in order 
to derive the composite reliability values. 

The com;^osite reliability values were derived by location (Table F-2) and it was 
those values which were subsequently employed throughout the remainder of the analyses. 
A better procedure would have been to derive a composite reliability value for the 
total of N = 949 technicians and employ those values for subsequent analyses rather 
than by the use of "per location" composite reliability values. However, as can be 
observed in Table F-2, the composite reliability values do not differ significantly 
by location except in two cases: Job Activity No. 7 in the RD rating and Job Activity 
No. 3 in the TM rating. 

Effect of the Convention on the Performance Estimates SRE, PRE, and GRE 
The Convention in the RD Rating 

For the RD rating the composite reliability value is 0.0 for Job Activity No. 7 at 
Location No. 2 (Table F-2). However, at Location No. 2 the RD's received SRE = PRE = 0.0 
{see p» 3 and footnote 2) because all (but one) RD at that location either did not work 
at Job Activity No. 7 or received EUE = rui = 0 (see Table E-1). In addition to the 
low SRE and PRE scores resulting from the use of this convention at Location No. 2, it 
must be oointed out that low scores were likewise recorded for the TPCF at that location 
(Table 4). This effect would result in a high degree of association between the pre- 
dictor and criterion variables for the RD rating at Location No. 2 because low predictor 
scores are corresponding to low criterion scores. This situation, however, is unique 
to the RD rating at Loc:tion No. 2. 

At Location No. 1 the situation of a high degree of association between the predictor 
and criterion variables was not illustrated for the RD rating. As at Location No. 2, 
most of the RD technicians are in the lowest TPC levels (Table 3) and every RD at Loca- 
tion No. 1 did not work at Job Activity No. 7 or received ZUE = ZUI = 0 (Table E-1). 
However, all the composite reliability values are high for Location No. 1 (see Table F-2) 
implying that most likely the SRE and PRE are different from zero and of a large magni- 
tude. This characteristic of the SRE and PRE would imply an inconsistency with the low 
TPC levels recorded at Location No. 1. Namely, an inverse relationship has been created 
at Location No, 1 essentially due to the convention that was adopted. That is^ high 
predictor scores correspond to low TPCF scores in the RD rating, whereas at Location 
No. 2, low predictor scores are associated with low TPCF scores. It may be said that 
this effect at Location No. 1 has significantly contributed to the low correlation 
values that were subsequently calculated (see Tables 6 and 7). However, in terms of 
composite reliability values, the correlations are most correct at Location Mo. 1. Only 
at Location No. 2, where as previously noted> there is an inconsistency in the composite 
reliability values, were the performance estimators, SRE, PRE, and GRE able to correspond 
to the low TPC levels and, thus, Incidentally, produce higher correlations. Therefore, 
the correlations obtained at Location No. 1 probably reflect the most accurate portrayal 
of the use of composite reliability values. 
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The Convention in Other than the RD Rating 



Now except for the extreme case mentioned above in the RD rating, all other com- 
pos-ite reliability values in Table F-2 are high. This is in close agreement with the 
TPCF results (Tables 3 and 4) for the EM, tT, FT, and IC ratings. The rJistribution 
of TPC levels for those ratings demonstrate a high concentration of individuals in 
the highest level of technical proficiency. On the other hand, in the RM, ST, and TM 
ratings, the distribution of TPC levels is uniform or demonstrate a hicjher concentra- 
tion of technicians in thv^ lowest level of technical proficiency, but ';he composite 
reliability values are high. 

Now it is difficult to generalize as to how the above observations are reflected 
in the estimators SRE, PRE, GRE, and WRE for association with TPCF results. This de- 
pends on the frequency with which the composite reliability values are used (Table 
E-1). However, it seems true that the greater the frequency of use of the composite 
reliability value the less agreement of the TPCF with the reliability estimators. 

Observations on tne Use of Composite Reliability Values 

As with any convention one employs, there seems to be a degree of artificality in 
the composite reliability values, for it would probably be easy to select a convention, 
by rating perhaps, which would allow the estimators to have a significant degree of 
promise in all ratings. This, of course, is a most inappropriate means by which to 
evaluate an estimator. However, results of this research effort seem to indicate that 
it is not the uis of any convention that is posing difficulty, but rather its overuse. 
As discussed in Appendix E, there were 42 (out of 164) rating-job activity combinations 
where the convention had to be employed on at least one-third of the technicians in 
some job activity and rating. Such a high use of a convention can only force the 
indiviaual performance estimates (in particular the SRE, PRE, and GRE) to more reflect 
the effect of the convention rather than individual performance. 

This observation is further reinforced with the WRE by the frequency with which 
it, must employ the convention. This estimator only employs the convention for the 
case in which the technician received zUE = ZUl = 0. The case in which the technician 
did ,.ot work at the job activity is ignored by this estimator. Table K-1 reflects the 
improvement in nonuse of the convention. It is believed that in no small way does con- 
sidering only the job activities a technician works at and then appropriately weighting 
those to form a reliability value permit a greater reflection of individual performance 
and subsequently a greater degree of association with the TPCF. 



Conclusions 



In conclusion the more promising estimator of electronic maintenance performance 
as a function of uncommonly effective and uncommonly ineffective performance incidents 
is a performance estimator similar to the Weighted-Average Reliability Estimate (WRE). 
This conclusion is made under the assumption that composite reliability values are 
employed in those job activities in which o man does not work at or received ZUE = ZUI = 0. 
However, even this estimator cannot be recommended for general use Mthin the U. S. Navy 
at the present time. Only in the EM, ET, FT, and IC ratings is its use presently war- 
ranted, while application in the RM, ST, and TM ratings is tenuous. It is suggested 
that before this estimator is employed in other ratings that the appropriate job task 
analysis and isolation of job activity factors be completed before a validation effort 
is attempted in that rating, perhaps similar to the procedures conducted in this report. 
That it is necessary to perform a validation effort was illustrated in this research 
effort by the results obtained in the RD rating. It would seem that it is too much to 
assume that the technique can be automatically applied to other ratings with even 
similar job activities. 
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Finally, the results of this research effort do demonstrate that the performance 
measurement technique being resnarched does have a large degree of potential for practical 
application on specific ratings within the U. S. Navy. In particular, the detailed 
analyses of the Technical Proficiency Checkout Form (TPCF) demonstrated the potential 
of that instrument to isolate job tasks which may require further training on the part of 
some technicians. Likewise the Job Performance Questionnaire can also be employed to 
Isolate those Individuals of potential detrimental performance levels in terms cf ex- 
cessive uncommonly ineffective incidents of performance. Even though such instruments 
are completed by the technician's; immediate supervisor, as opposed to an unbiased eval- 
uator, those positive qualities of the performance measurement instruments can prove to 
be most valuable even if one is not interested in deriving an estimate of the probability 
of effective performance .or the technician evaluated. Therefore, short of a procedure 
which allows for a completely unbiased evaluator, the technique must be given credit for 
being perhaps the most viable performance meaiurement technique presently available and 
of being of greatest potentital value to the U.S. Navy. 
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JOB PERFORMANCE QUESTIONNAIRE 

Name of Supervisor Rating Ship or Unit_ 



Instructions to Supe.vistir. The purpose of this form is to determine the 
number of effective and iticffective performances you have observed amongyour 
mpn during the oast two months. We are only interested in the unc ommon \ y ef' 
f tfc t f and the uncommon I y i ne f c t i u e performances. 

List below the names of ali the men under your supervision who are currently 
striking for, or in any of the following ratings: DS, EM, ET, FT, IC, MT, RD, RM. 
ST, TD, TM (AE, AT, AQ, AX). If you supervi se more than one of these ratings, 
please u:.e a .. rip-.fa'.i- form for each rating. 

Now, considering the fleet electronic maintencince objectives, enter your estim ite 
of the r.un-ibei' of uuco::i::io;.ly rff»'Cti'v C (UT-) i.:\d uncomnvoiily ineffective (I'D per- 
formances during the past two months for each man being rated. Please refer to the 
definitions lists for the meanings of the JOB ACTIVITIES and of the OBJECTIVES 
involved. 

The first line has been filled in as an example. The supervisor completing the 
example felt that Peter Smith had ten unusually effective performances and two 
unusually ineffective pc ,:o"m 'nces while performing Electronic Circuit Anal- 
3C$ when considered against objectives of fleet electronic maintenance. He 
also felt that Smith shov/ed tw o uncommonly effective performances in the area of 
E lectrosafety and four uncommonly ineffective performances in Instruction, 

If a man has not had an opportunity to perform in a particular area, enter a dash (-); 
if he has had an opportuiuty but has not shown any uncommonly effective or ineffec- 
tive performances, enter a zero (0). 
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T E C H'M I C A L P R O F i G I E fj C Y- 0 H E C K 0 U T FORM 



NAME OF SUPERVISOR 



RATING/RATE 



FULL NAME OF MAN EVALUATED^ 
SHIP OR UNIT 



LOCATION 



DATE 



TASK DESCRIPTION 



1. Capable of employing safety precautions on most 
of this unit s equipment with which his rating 
is concerned. 

2« Capable of replacing most of this unites equip- 
ment with which his rating is concerned, 

3. Capable of removing most of this unit's equip- 
ment with which his rating is concerned, 

4. Capable of following block diagrams for most of 
this unit's equipment with which his rating is 
concerned • 

5. Capable of knowing relationship of equipment to 
other related equipment with which his rating 
is concerned. 

6, Capable of calibrating most of this unit's equip- 
ment with which his rating is concerned* 

7, Capable of trouble-shooting/isolated mal - 
function(s) in most of this unites equipment 
with which his rating is concerned. 

8, Capable of employing electronic principles 
involved in^aintenance of most of this unit ' s 
equipment with which his rating is concerned. 



CHECKED 
OUT 



□ 

□ 
□ 

□ 

□ 

□ 
□ 

□ 



NOT 
CHECKED 
OUT 



□ 

□ 
□ 
□ 

□ 
□ 
□ 
□ 



MAKE CERTAIN THERE IS AN "X" IN A BOX OPPOSITE EACH TASK DESCRIPTION 
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DESCRIPTION OF JOB ACTIVITIES 



JOB ACTIVITY DESCRIPTION 



Using Reference Materials — includes the following type of activities: 

e. use of supporting refer ence mater ials 
b. making out reports 

Equipment Operation — includes the following type of activity. 

a. operating equipment, electrical and 
electronics test equipment , and 
other electronic equipments 

Electronic Circuit Analysis — includes the following type of activities 

a. understanding the principles of 
electronic circuitry 

b. making out failure reports 

c. keeping records of maintenance 
usage data 

Personnel Relationships — includes the following type of activity: 

a. supervising the operation, inspection, 
and maintenance of electronic equip- 
ments 

Electro-safety — includes the following type of activity: 

a< using safety precautions on self and 
equipment 

Instruction- — includes the following type of activity: 

a. teaching others how to inspect, 
operate, and maintain electronic 
equipments 

Electro-repair — includes the following type of activity: 

a, equipment repair in the shop 
Electro-cognition— includes the following type of activities: 

a. maintenance and troubleshooting of 
electronic equipments 

b. use of electronic maintenance 
reference materials 



MEANINGS OF FLEET ELECTRONICS MAINTENANCE OBJECTTVES 



1 . Readiness 

To maintain efficiently self, subordinate personnel, equipment, 
and systems in state of readiness consistent with fleet requirements* 

2. Performance 

To complete any given mission in minimum time with appropriate 
level of accuracy and reliability. 

3. Operation 

To obtain optimum system output when equipment is operated, i.e,, 
output characterized by precision and variability appropriate to mission. 

4. Safety 

To carry out duties with maximum protection for men and equip- 
ment consistent with mission. 

5. Preparation 

To prepare for personnel requirements of present and future equip- 
ment, systems, and situations through use of training programs, maintenance 
of high morale, etc. 
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PROCEDURE EMPLOYED IN DATA COLLECTION 



The data collection effort originated by requesting of CINCPACFLT 
and CINCLANTFLT that ships (Destroyer-type vessels) and men (in the 
electronic maintenance ratings - EM, ET , FT , IC, RD, RM, ST, and TM) 
be considered for participation in this project. It was requested that 
initially a project coordinator at an appropriate fleet command be 
assigned in order to coordinate the efforts of the project researchers 
from NAVPERSRANDLAB and ship liaison officers. Favorable response from 
both fleet commands resulted in the assignment of the following project 
coordinators : 



LCDR G. W. Dunne 
Flag Secretary 

Cruiser-Destroyer Flotilla Nine 
FPO San Francisco, CA 96601 
(located at the U.S. Naval 
Station, San Diego, CA) 



ROCS C.J. Masterson 

COMCRUDESLANT Staff 

CRUDESLANTFLT 

FPO New York, N. Y. 

(located at the U.S. Naval 

Station, Newport, RI) 



The duties and responsibilities of the project coordinator may be 
outlined as: 



1. identifying the ships available for participating 
In the project. 

2. seeking the assignment of a liaison officer (usually 
the senior electronics materials officer) aboard each 
available ship to coordinate the data collection aboard 
that ship. 

3. scheduling the meetings between the ship liaison officers 
and the project researchers. 

4. making appropriate checks on the progress of the data 
collection effort aboard each ship. 

5. collectiori and reviewing for completeness of the data 
forms bef'jre mailing all forms to NAVPERSRANDLAB. 



Once the project researchers had established the ships and liaison 
officers of those ships that were participating in the project, an initial 
meeting was arranged between the ship liaison officers and the project 
researchers. At this meeting the researchers explained the purpose of 
the project and outlined the duties and responsibilities of a ship liaison 
officer for completing the data collection effort aboard his ship. It 
was emphasized that it would be the ship liaison off»<^ers responsibility 
to perform all phases of the data collection effort aboard ship. 
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Each liaison officer was given a set of instructions (Appendix C) 
which outlines in detail the steps he was to perform in order to complete 
the data collection effort aboerd his ship. Essentially it was required 
that the liaison officer select immediate supervisors of men involved in 
electronic maintenance activities in the EM, ET, FT, IC, RD, RM, ST, and 
TM ratings who may participate in the project. Each liaison officer was 
also given a set of Roster Forms (a sample of a Roster Form can be found 
in Appendix C, page C-8). One Roster Form was completed by the liaison 
officer for each supervisor participating in the project and it includes 
a list of the men the supervisor is to evaluate. A technician occurred 
on this list if that supervisor had been his immediate supervisor for at 
least the past two months, length of the evaluation period, and the techni- 
cian at that time was at most a petty officer second class in one of the 
aforementioned ratings. In order to achieve the most reliable information 
aiid not to place too much of a burden on any one supervisor, the supervisor 
was limited to evaluating no more than seven men - the seven, or less men, 
he would be most knov/ledgable about with respect to their on-the-job 
performance . 

At the second and final meeting, the Roster Forms were returned to 
the project researchers who gave a Xerox copy of these forms to the ship 
liaison officer and the project coordinator. Using the Roster Forms the 
project researchers completed packages of Performance Evaluation Forms, 
one such package for each supervisor. Each package contained a set of 
Instructions for the Supervisor for Completing Performance Forms (Appendix D) , 
a Xerox copy of the appropriate Roster Form listing the men that the super- 
visor is to evaluate, and the appropriate number of sets of Performance 
Evaluation Forms (discussed in the section. Data Collection Instruments) , 
one set for each technician the supervisor was to evaluate. 

Upon returning to his ship, the liaison officer held a meeting with 
the supervisors to explain the purpose of the project and to describe how 
they were to complete the sets of Performance Hva'iuation Forms. Once the 
supervisors had completed their evaluations, the liaison officer submitted 
all forms to the Administrative Officer aboard his ship who provided the 
additional demographic information on the men evaluated. After this exer- 
cise the ship liaison officer returned all forms to the project coordinator. 
The project coordinator, once he received the completed forms from all the 
ships, mailed all forms to KAVPERSRANDLAB . 
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APPENDIX C 



INSTRUCTIONS FOR 
SHIP LIAISON OFFICER 



NOTE: The instructions on pages C-S thru C-12 
(pages -1 thru -5 of the text of the in- 
structions and pages -1 and -1 thru -4 
for enclosures (1) an'J (2) respectively) 
of this report are paginated for publica- 
tion. For economv of re\)roddction , the 
page nur-rbers were not changed for this 
report. 
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NAVAL PERSONNEL RESEARCH AND DEVELOPMENT LAPORATORV 
Washington, D. C . 



Performance Evaluation Measures 
Information to Stiip Liaison Officers 



Background 

The general purpose of the present study is to further investigate 
an economical and practical method for providing feedback information 
regarding the readiness of Naval electronically oriented technical per- 
sonnel (specifically EM, ET, FT, IC , RD, RM, ST, and TM ratings) for 
completing their assigned mission. Essentially ^ a result of the study 
may include the application of a performance evaluative technique which 
will allow continuous anc quantitative answers to questions such as: 
What is the current level of effectiveness of the maintenance personnel 
in a given rating, ship, or squadron? How does the maintenance prirsonnel 
effectiveness level of a given rating, ship, or squadron compare with 
that of other ratings, ships, o^ squadrons? 

In a previous Office of Naval Research study, a unique performance 
measurement technique was developed which thd Naval Personnel Research 
and Development Laboratory is now concerned w±th replicating in order to 
establish its validity and to determiv^e the practicality of this concept. 
Basically, eight dimensions of the electronics maintenance ratings were 
defined: (1) using reference materials, (2) equipment operation, (3) 
electronic circuit analysis, (4) personnel relationships, (5) electro- 
safety, (6) instruction, (7) electro-repair, aad, (8) electro-cognition. 
On the basis of a supervisor observing his men performing on the job, 
he indicates the number of times that he saw unusually effective or 
unusually ineffective performance demonstrated on each of tl.e eight job 
dimension^. leased upon the estimates of unusually ef f ective/'? nef f ective 
behavior, meaningful measures of technician effectiveness can be est.^b- 
lished. Further, tie individual C'.:chnician effectiveness values :xu 
be further treated to form ef f e^- tiveness indices for ratings, ships, 
and squadrons. 

Because this effort is primarily concerned with replicatiag a prior 
study, any information provided by ship personnel will be used only for 

esearch purposes by the Naval Personnel Research and Developmerv, Lab- 
oratory and only to serve as a statistical data base for validating the 
results of that prior study. Furthermore, any comparisons made between 
ratings, ships, or squadrons will be used only for research purposes. 
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Si :^.^g£^st ed Ship Li.iisor. Of l i-jor A.^ '. s 1 tinncG Plan 

The steps outlined below arc; those as envisioned by the project 
researchers which you may exe^.ute in order to' insure an efficienL data 
collection effcut aboard yoiir siiip. 

Completion o f t he R o s t er r o r ms 

Either a i^rojcrt r cs^.-'ci-'<-c]j.>r or tl-v pro^e^t coordinator at CPi'l if /'VANT 
ha s given you a :> e l c; f K o s t i • r r'o r s ( e r: c 1 'o y u r e ( 1 ) ) . To c omp 1 r e I • e 
Roster Forms you a^'e to sOiCM t: men ir.volved in electronic maintenance 
activities in th:-^ FM, KT , Fi , I C, i<D ^ HM, ST, and TM r atin£S and immedfat 
supervisors of those rnen ahoar<i your ship. (jonerally the niexi being 
evaluated will be petty officers second class and below. The supervi ^-c^ rs 
may be either enlisted perscmnel or officers but must be the immejj. a t : 
supervisors of the men tiioy are to evaluate. They should have knovrn t 
men they atre evaluar. Ing fnr c-A. Ic.ist the past two months. Not all super- 
visors of men in rlu- prevl(.::sly n)t -^.t :! oned ratine.s will qualify for partxc 
ipation in tiiis prc^jecL, hov/ever, li. is desired . that all individuals in 
the above ratinj^s rvar ti c i pa to . Once you have completed the Roster Forms, 
go to each supervisor tr^ participate in. this project and have him verify 
that h^' is the inmodiat:c supervii^or of fhe men that you have selected for 
him on the respecrJve R<]stc;r Form, 

Once the Roster 'rorrn-; iviv-.i be:m verified by the supervisors, send a 
cv^py of these fc":i;-^ to: 

i1 r . B e r n a r d Ra f a c z 
Haval Poirsonne 1 Research 

arid Development Laboratory 
Room 3315, Bldg. 200 
Waslvi.n^^ton Navy Yard 
Vashinf-ton, D. C. 20390 

is your cor.tri'-L man nt Mie Mav.i 1 Per?=innnel Research and Development 
Laboratory. 'A' you, l^ave any problems or qi -^stions concerned with the 
iiapleiTjenta tion of the i r.s r ruc r ions , it may be possible for you co contact 
him (AUTOVON 288-445 7) or the project coordinator. 

He will prepare the packages of Performance Evaluation Forms for 
mailing to you. One such package is a blue folder containing a set of 
Instructions to th.e Supervisor on the left inside cover and sets of 
performrfnce evaluatim Forms on i.ne right. On the front of each package 
is a label with the name of the supervisor who is to complete the sets 
of performance ev.ii iia t ion forms contained therein on the men for whom 
Vie is their immediate supervisor. 
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Briefing Each Supervisor 



Once you have received the Packages of Performance Evaluation Forms 
from the Naval Personnel Research and Development Laboratory, you are 
now ready to distribute these forms to the supervisors participating in 
this project. This may be done in one of tvo ways: 1) calling a meeting 
of all supervisors so that you may distributB the packages and brief them 
as to their responsibilities all at one time, or, 2) mr-et individually 
with each supervisor and instruct him on a personal basis as to his 
responsibilities in completing the experimental forms. 

It is your choice as to which procedure to follow, howevor , for ships 
with only several sup^-rvisors participating, the lattar metb.a-i mav he the 
most convenient. 

When meeting with the supervisor you should instruct him on the same 
subject material as you vjcre originally briefed either by the project 
researcher or the project coordinator at CRIJDESLANT. In particular, 
you should guide the supervisor through his set of Instructions, going 
over the three SAWI.E pages of perforrnHnce evaluation forms. Important 
things to mention to the supervisor about the throe forms in each set of 
Performance Evaluation Forms are oi.tlined bolov?. 

1. The Personnel Identification Information Forr; (PIIF) 

The purpose of th:s form is to providp various hacV ground 
information on ti'.c man being evaluated. The supers.' i sors should 
first of all supply ^h^: information at the top of this form, Gu^v 
the background information to the right of the cross^ha tclicd area 
is to be supplied by the supervisor. Please tell him that he must 
do this to facilitate the job of the Administrative Officer aboard 
his ship. Bfecause he is normally in everyday contact witli che men 
he is evaluating, it should not be too difficult to obtain this 
infcimation directly from the man being evaluated. The information 
to the left of t^ ross-liatcherl area v;il-l be supplied by the 
Administrative " :er al^oard your ship and so the supervisor 
should not cone himself v/ith this section of the PIIF. If for 
some reason he cannot obtain some of the background information 
from the man beiiig evaluated, please have the Administrative 
Office:: supply this information at a later date. Particular 
instructions for completing this form are given in the Supervisor's 
Instruction Package. Please be sure that he understands these 
instructions and the correct procedure for enteving the requested 
information on the blank PIIF Op-?can Sheet in each set of 
experimental forms. 



2. The Technical Profici^ncv Checkout Form (TPCF) 



This fonn is designed to estimate tre level of technical com- 
plexity at which a man is able to work without direct supervision. 
The supervisor should provide the information at the top of the 
TPCF. The eight task dt'^criptions are listed in ascending order 
of diff icuity with t<^sk iJo, 8 identified as the most difficult 
cask. The sr^pervisov is simply to record an "X" in the CHECKED OUT 
hok for RacVi task which he fee^'.s the racee is capable ot performing 

on his cvn wi thout d ir ec t supervision.'' Otherwise he should 
record an "x'' in the NOT CHECKED OUT box. The supervisor must be 
certain there is an "X'* in a box opposite each task description. 

3. The Job Perfomianco Questionnai. j (JPQ) ANSTOR SHEET 

The JPQ ANSWER SHEET is undoubtedly the most difficult form we 
are asking the supervisor to complete. However, the researchers 
have tried to facilitate the understanding of what information is 
requested by giving explicit samples to each question to be answered. 
In particular the JPQ /u\SWER SHEET records estimates of the total 
number of uncommonly effective (UE) and uncommonly ineffective (UI) 
.incidents of performance tiie supervisor has observed over a prior 
two month period on the man being evaluated^ Read page 7 of the 
Supervisor's Instructions aloud to every supervisor and be sure 
that he und t.^rs tands what he is expected to record on the JPQ ANSWER 
SHEET. .\t the top of page 9 is a definition of what is generally 
meant as an uncomnionly effective or uncommonly ineffective per-- 
tor mane p However, the supervisor should not adhere strictly to 
this definition. He would best know for his particular working 
area what such performances are. . He should use the researchers 
definition only as a guide to conceptualize upon tlie extremes of 
performance. 

Page 13 of the Supervisor's Instructions is a SAMPLE of a JPQ 
^vNSWER SliEET found In each £et of performance evaluation forms. 
The suporA/Lsor must review the table on page 9 together with the 
sample iu order to understand where and how to record a:.s estimates 
of the total number of UE and L'l incidents of performance on the 
JPQ ANSWER SHEET. Please review this table with him. Also remark 
on the NOTE at the bottom of page 9. 

QUESTION (c) on page 11 of the Supervisor's Instructions must 
be answered in column (c) for each job acti v ity . Please point 
this out to tliC- supervisor. 

Three remaining questions given on pages 11 and 12 of the 
Supervisor Vs Instructions are to be answered in the lower corner 
provided on the JPQ ANSWER SHEET. Finally the supervisor is to 
place his social security account number in the space provided 
on each JPQ ANSWER SHEET he completes. 
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Instruct the supervisor that he will have approximately one 
week to complete all forms for the men he is to evaluate. It is 
important that he realizes that the Op-Scan sheets (the PIIF and 
JPQ ANSWER SHEET) w ill be machine processed and therefore it is 
essential that they remain as much in their original condition 
as is possible . Once the supervisor compleces the forms, he must 
return them to you in the original folder, as you submitted them 
to him. You should review the forms as they are submitted and 
check that all of the information that is requested has been 
provided. ^^lease be sure that each form of each set contains the 
supervisors name and the technician's name ?'n the proper locations. 



4. Briefing the Aa.^inistrative Officer 



It Is now necessary that you submit all packages to the 
Administrative Officer aboard your ship :.n ordt r that the Personal 
Identification Information Form (PIIF) be compL.^ted for each man 
evaluated. Enclosure (2) is a set of Instruct: ens Tor the 
Administrative Officer. You will have to request his assistance 
in order that the information to the left of the cross-hatched 
area on each PIIF be completed. All of this informai'ion may be 
found in the personnel jacket of the man being evaluated. Com- 
plete details for providing this information re contained with- 
in the Instructions to tlie Administrative Officer, To insure 
that the forms are properly completed, you should review these 
ini:;truct ions wich him. 



Once the Administrative Officer has completed all the PIIFs and 
returned all packages to you, from each set of Performance Evaluation 
Forms remove the pape r clip . (For Op^Scan purposes it is imperative 
that the forms aj.'t lOt bent.) All completed packages and any extra 
forms are to be given to the project coordinator, lie will send them 
back to Mr. Rafacz at the Naval Personnel Research and Development 
Laboratory. 
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SAMPLE 



ROSTER FORM 



Name of Liaison Office r George Merklin 

Shi p ^^^^^ Homeport Location ^^ewport 



Date ^ ^2 



Immediate Supervisor_^ 



Abner Smith 



_Rating/Rate_ 



EMC 



Naraes of Men to be Evaluated 

Tom Henry Jones 

Georc^e iHlliam Ktack 
Rohei t Larry Lane 



Rating/Rate 

EM3 

RMSN 
ETN2 
etc. 
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Enclosure (1) 



NAVAL PERSONNEL RESEARCH AND DEVELOPMENT LABORATOR/ 
WASHINGTON, D.C. 



Instructions for the Administrative Officer 
Completing the Personnel Identification 
Information Form (PIIF) 



Recently your ship and some supervisors of men in the electronic or 
related ratings - EM, FT, ET, IC, RD, RM, ST, TM - aboard your ship have 
been selected to participate in a performance evaluation program being 
conducted by the Naval Personnel Research and Development Laboratory. 
The mer?. selected are immediate supervisors of personnel in those ratings. 
The liaison officer aboard your ship in charge of coordinating the activ- 
ities between the researchers and your ship for this program has given 
each such supervisor a package of materials containing a Supervisor's 
Instruction Package and sets of Performance Evaluation Forms; one set for 
each man the supervisor is evaluating. Every sot of Performance Evalua- 
tion Forms is made up of the following forms: 



1. Personnel Identification Information Form (PIIF) 

2. Technical Proficiency Checkout Form (TPCF) 

3. Job Performance Questionnaire (JPQ) ANSWER SHEET 



The supervisor will complete in part a set of Performance Evaluation 
Forms for each man he is evaluating. Only the Personnel Identification 
Information Form (PIIF) found in each set is to be completed by the Admin- 
istrative Officer, In essence, this form records various background 
information on the man being evaluated. Once the supervisor has completed 
supplying the information requested on the set of Performance Evaluation 
Forms, he will return them to the liaison officer who in turn will give 
them to you, the Administrative Officer, in order that the PIIF in each 
set be completed. For each PIIF you receive, the supervisor was to have 
supplied the information to the right of the cross-hatched area on this 
form. The first thing you should do is to check over this section of the 
form and see that all of the following information was provided for the 
man being evaluated: 



a. Technician's Name 

b. " Social Security Number 

c. " Birthdate 

d* " Months Known by Supervisor 

e, Months on Current Job Assignment 

f, " Months of Active Duty Service (USN* and USNR**) 

g, Rating and Paygrade 

*Record 99 months for USN if the Technician's Months of USN Active Duty 
Service equals or exceeds 99 months, 

**Record 99 months for USNR if the Technician's Months of USNR Active Duty 
^ Service equals or exceeds 99 months. 
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Enclosure (2) 



If some information in this section is omitted, please provide it. 
Use only a #2 pencil when supplying any information on this form. To aid 
you in completing the PIIFs, page 4 of these instructions contains a jsample 
of a completed PIIF. From this sample you will see that the following 
information is obtained from the section of the form to the right of the 
cross-hatched area: 

1. The supervisor is EMC Abner Smith located at Newport aboard 
the USS ROAN and completed this form on 7 January 197 2. 

2. This supervisor was evaluating EM3 Tom Henry Jones whose social 
security account number is 123-45-6789 and he was born in 
March, 1948. He was known for 13 months by the supervisor, 

and had been 15 months on his current job assignment, Jones 
had served no USNR active duty time but had been on USN 
active duty for 29 months. 

One you have reviewed the sample on page 4 for that section, turn 
your attention to the section of the PIIF to the left of the cross- 
hatched area. The following table represents all of the information for 
this section that is to be provided b;> you from the service record for 
the man being evaluated. 



Item 



Location in Service Record 



Final Mark 



Class Standing 



Class Size 



A School 
B 
C 

A 
B 
C 

A 

B 
C 



NAVPERS 601-4 



Years of Civilian Education (Yrs. Ed.) 



NAVPERS 601-3 



GCT Score 
ART 

MECH " 
CLER 



If 
II 
11 
tl 



In all cases the most recently completed A, B, or C school information 
is to be provided. If for sooe reason a technician did not attend some of 
the schools s leave that section of the PIIF blank for that school. A 
Final Mark such as 54,23 is recorded as 54.23 on the PIIF, Final Markf? of 
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the form, 90^ 82, 77, etc., (i.e., two digit scores) are recorded as 
90.00, 82,00, 77*00, etc., respectively. If some schools gave a Final 
Mark of "satisfactory'* or "unsatisfactory", record 99.99 for a satisfactory 
Final Mark and 00.01 for an unsatisfactory Final Mark. 

Once again turn to page 4 of these instructions which contains the 
previously mentioned sample of a PIIF and to the section to the left of 
the cross-hatched area. From that section of the sample foi*m, the fol- 
lowing table represents the information the Administrative Officer aboard 
the USS ROAN providr^-^ on F.M3 Tom Henry Jones: 



Ite^ 



As recorded in Service Reord 



Final Mark 



A School 
B 



77,86 

(did not attend B School) 
90 



Class Standing 



Class Size 



II 

Tl 

TF 



Years of Civilian Education (Yrs. Ed.) 



57 th 

26th 

122 

27 

12 



GCT Score 
ARI " 
MECH " 
CLER " 



50 
49 
56 
47 



If you have any questions regarding the type or the recording procedure 
of any of the desired information, please consult the liaison officer for 
this project. Once all PIIFs in all sets of Performance Evaluations Forms 
have been completed by you, return all packages to the liaison officer. 
Thank you for your cooperation and efforts in completing these forms. 
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APPENDIX D 
INSTRUCTIONS FOR SUPERVISOR 



NOTE: The instructions on pages D-3 thru D-1 5 
(pages -1 thru -13) of this report are 
paginated for publication. For economy 
of rf ^-oduction, the page numbers were 
not -<anged for this report. 
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THIS PAGE IS BLANK 



NAVAL PERSONNEL RESEARCH AND DEVELOPMENT LABORATORY 
WASHINGTON, D.C. 



Instructions for the Supervisor for Completing 
Performance Evaluation Forms 



You, as a supervisor, have be^n selected to participate in a perform 
ance evaluation program being cor.ducted by the Naval Personnel Research 
and Development Laboratory, Performance evaluation in the U.S. Navy has 
served as a guideline for the optimal positioning '-.f manpower and for 
feedback on Naval school effectiveness. It is felt that you will be the 
most qualified to give accurate and meaningful information on the perform 
ance of the men you supervise* For that reason it is necessary that you 
make an earnest effort at providing the information requested of you. 
Without your support and hone.r>t etCorLs, the time and funds put into this 
research endeavor will have been i'L^^2.ated. 

You are asked to complete a set of three performance evaluation 
forms for each petty officer and designated striker - in the EM, ET, FT, 
IC, RD, RM, ST, and TM ratings only - over whom you have immediate 
supervision. The titles and descriptions of the three experimental 
forms are: 

1. P ersonnel Identification Information Form (PIIF) - this form 
is concerned with the background data of the man you are evaluating. 
You will complete part of it and the Administrative Officer aboard your 
ship will supply the remaining information, 

2. Technical Proficiency Checkout Form (TPCF) - this form records 
the level of techrical complexity at which a man is able to perform 
without direct supervision. 



3. Job Performance Questionnaire (JPQ) ANSWER SHEET - this form 
records your estimates of the number of a man's uncommonly effective 
and ineffective performances that you have observed during a specified 
time period. 

From your ship's liaison officer, who is coordinating this project, 
you have received a packet of materials containing these instructions 
and a number of blank cop:;.es of the three forms just described. Ad- 
ditional blank forms may also be obtained from the liaison officer if 
yo I nefid them. Together, these forms - the PIIF, TPCF, and JPQ ANS\'JER 
SHEET - constitute a full set of Performance Evaluation Forms. You 
are to fill out one of each type of form - one complete set of three 
forms - for each man whose performance you evaluate. You will have 
approximately one week in which to complete the sets of Performance 
Evaluation Forms for all the men who have been designated for you to 
evaluate. Please remember to use only a #2 pencil in filling out the 
Performance Evaluation Forms. 



Turn now to pages 4, 6, and 13 of these instructions. On those 
pages are samples of l:he three Performance Evaluation Forms. Notice 
that each of the three sample forms is preceded by a page of instruc- 
tions. These particular sample forms were completed for the following 
typical, naval situation. 

EMC Abner Smith is the immediate s^^pervisor of seven men 
aboard the USS ROiVN located at Newport. He had beeii given 
seven sets of Per forma Evaluation Forms, witli a Super- 
visor's Ins true Lion Package, by the liaison officer aboard 
the USS ROAN. During the week of 7 January i972, he com- 
pleted all Performance F-valuation Forros. One of the men 
he evaluated was EM3 Tom Ho.nry Jones. The samples on 
pages 4, 6, and 13 are therefore the PIIF, TPCF, and JPO ANSWER 
SHEET contaJning information on E^^3 Tom Henry Jones furnished 
by his s u p e r V i r> o r , EMC \h ne r Sn] i t h . 

Before starting on the ]^er f o rn^i : ice Evaluation Forms, study the samples 
tliat: are included .in tlw^se instructions. Please do not let your answers 
be influenced by tho. information given on the sample Performance Evaluation 
Forms. Tlie answers given on the sample forms are meant only to be guides 
in aiding you to conipi.ete your forms on tlie men you evaluate. 

All responses tv qut-stions are completely CONFIDENTIAL. Any in- 
formation you provide \ ".1]. be used only by the researchers of the Naval 
Personnel Researcii :nul Devt^lopment Laboratory, Ttiid only to serve as a 
statistical data ba?;^ for arriving at performance estimates of enlisted 
naval personnel i n general . 

Your help and cooperation in participating in this project are 
greatly appreciated by r:he project researchers at the Naval Personnel 
Research and Development Laboratory. 
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Instructions for Completms the PIIF 

The Personnel Identif icatici; information Form (PIIF) records various 
background information on the man you are evaluating. Refer to the sample 
PIIF on page 4 of thtc'e Instructions and the DIRECTIONS given there. Noce 
that you need furiiish only the information requested to the right of tht : 
cross-'hatched area, namely: 

a. Technician's Name 



b. " Social Security Number 

c. " Birthdate 

d. " Months Kiiown by Supervisor 

e. ^' Months on Current Job Assignment 

f. " Monthr, of Active Duty Se rvice (USN* and USNR**) 

g. " R aring and Paygrad" ^ 



It is understood that you will obtain most of this information directly 
from the man you are evaluating. It is impcrtant that this background 
information be as accurate as is possible, I.^' you doubt the accuracy of 
any of the information you have obtained from the technician, or if you 
are unable to obtain it, please ask the Administrative Officer aboard your 
ship to provide you with the correct information. In addition, you as the 
supervisor will also fill out the two upper left lines of the PIIF. This 
includes your name, rating and rate, date, ship and its current homeport 
location. 

From the sample PIIF on page 4, notice that the following information 
is obtained: 

1. The supervisor is EMC Abncr Smith located at Newport aboard the 
USS ROAN and completed this form on 7 January 1972, 

2. This supervisor was evaluating EM3 Tom Henry Jones whose social 
security account number is 123-45-6789, and he was born in March, 1948. 
He was known for 13 months by the supervisor, and had been 15 months on 
his current job assignment. Jones had served no USNR active duty time 
but had been on USN active duty for 29 months. 



*Record 99 months for USN if the Technician's Months of USN Active Duty 
Service equals or exceeds 99 months. 

**Record 99 months for USNR active time if the Technician's Months of 
USNR Active Duty Service equals or exceeds 99 months. 
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Instructions for Complftting the TPCF 



A sample of a completed Technical Proficiency Checkout Form is shown 
on page 6, 'comfdeted by EMC Abner Smith for EM3 Tom Henry Jones. Eight 
tasks are listed in descending order of difficulty. It is felt that an 
individual's overall proficiency is directly related to the highest level 
of task in the set which he can perform without direct supervision. 

Beginning with task description NO, 1. (Capable of employing safety 
precautions ...), place an "X" in the "CHECKED CUT" box if you feel that 
the man you are evaluating is capable of performing the task on his o\m 
without direct supervision . If you feel he is not able to perform the 
task on his own, place an "X" in the "NOT CHECKED OUT" box. Complete this 
form by going through the eight tasks described. Be sure to provide the 
information at the top of the TPCF form, to include your name, rating and 
rate, full name of the man evaluated, ship and its current homeport 
location, and the date. Refer to the sample TPCF given on page 6 of these 
instructions. You will notice that EMC Abner Smith marked EM3 Tom Henry 
Jones, as being "CHECKED OUT" on tasks 1 , through 6, but felt that he was 
not able to perform tasks 7 and 8 without direct supervision. 
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SAMPLE 



T E C H f] I C A L PROFICIENCY CHECKOUT FORM 



NAME OF SUPERVISOR /bnev^rdth 



RATING/RATE EMC 



Tom Iknrij Jones 



FULL NAItE OF MAN EVALUATED 

SHIP OR UNIT USS ROAN LOCATK'W Newport 



DATE " <Januavi{ ?P. 



TASK DESCRIPTION 

1. Capable of employ Ing safety precautions on most 
of this unit's equipment with which his rating 
is concerned, 

2, Capable of replacing most of this unit's equip- 
ment with which his rating is concerned, 

3 Capable of removing most of this unit's equip- 
ment with which his rating is concerned, 

4, Capable of following block diagrams for most of 
this unit's equipment with which his rating is 
concerned . 

5, Capable of knowinf^ relationship of equipment to 
other related equipment with which his rating 
is concerned. 

6, Capable of calibrating most of this unit's equip- 
ment with whicli his rating is concerned. 

7, Capable of trouble-shooting/ isolated mal - 

f unction(s) in most of this unit's equipment 
with which his rating is concerned. 

8, Capable of employing electronic principles 
involved in maintenance of most of this unit's 
equipment with which his rating is concerned. 



CHECKED 
OUT 



□ 
□ 



NOT 
CHECKED 
OUT 

□ 



□ 
□ 
□ 

□ 

□ 



MAKE CERTAIN THERE IS *^X" IN A BOX OPPOSITE EACH TASK DESCRIPTION 



Instructions for Completing the JPQ ANSWER SHEET 



The purpose of the Job Performance Quest lonnaire (JPQ) ANSWER SHEET is 
to record, for a given individual, yojr stimates of the total number of 
uncommonly effective and uncommonly ineffective incidentfi of performance 
you have observed during the last two months on cacn of ?i|^ht job activities 
(see page 8) , 

In previews efforts at evaluating the performance of :m individual, 
such as the reports of Enlisted Performance Evaluation, you mentally "aver- 
aged^' your observations of excellent and poor incidents of performance for 
that man in order to arrive at an overall performance esti.iate. However, 
in this project wc are asking you to focus your attention on only the 
extremes of performance — uncommonly effective and uncommonly ineffective 
perf ormances. In additiDn, we want you to disregard an individual's over- 
all performance and to record for each of the eight job activities the 
total number of times you have observed the occurrence of uncommonly 
effective and uncommonly Ineffciitive incidents of performance. 

As a general exair.ple, on a particular day a man has demonstrated two 
incidents of uncommonly effective performance while involved in the job 
activity Equipment Operation and no incident of uncommonly Ineffective 
behavior for that job activity on that day. Sometime later, on perhaps 
another day, he has demonstrated one uncommonly effective performance and 
one uncommonly ineffective performance for the job activity Equipment 
Operation, If in the past two months no other of his duties involved 
Equipment Operation, then your estimate of the total number of uncommonly 
effective and uncommonly ineffective incidents of performance, for that 
job activity , is three uncommonly effective and one uncommonly ineffective 
incident of performance. 

In order to determine exactly what specific types of activities you 
should consider in estimating whether the man has shown an "uncommonly 
effective" or an "uncommonly ineffective" performance, refer to the 
DESCRIPTION of that JOB ACTIVITY as given in the following list: 
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DESCRIPTION OF JOB ACTIVITIES 



JOB ACTIVITY DESCRIPTION 



Usin g Reference Materials — includes the following type of activities; 

a, use of supporting reference materials 

b, making out reports 

Equipment Operation — includes the following type of activity: 



a, operating equipment, electrical and 
electronics test equipment, and 
other elec tronic equipments 

Electronic Circuit Ana lysis ----includes the following type of activities 

a, understanding the principles of 
electronic circuitry 

b, making out failure reports 

c, keeping records of maintenance 
usage data 

Personnel Relationships — includes the following type of activity: 

a, supervising the operation, inspection, 
and maintenance of electronic equip- 
ments 

Elec tro-saf ety — includes the following type of activity: 

a, using safety precautions on self and 
equipment 

Instruc tion — includes the following type of activity: 

a, teaching others how to inspect, 
operate, and maintain electronic 
equipments 

Electro-repair — includes the following type of activity: 

a, equipment repair in the shop 
Elec tro-cognition — includes the following type of activities: 

a. maintenance and troubleshooting of 
electronic equipments 

b, use of electronic maintenance 
reference materials 
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Because you are the most knowledgeable of the^rea you supervise, you 
will know what incidents of performance can be labeled as uncommonly effec- 
tive or uncommonly ineffective. It is your standard that is to be used 
for this trial. However, to further as-sist you the researchers have pro- 
vided the following general definitions. 

An uncommonly effective performance in a specific job activity is an 
impressive and/or decisive Incident of performance qualitatively above 
those usually observed. Likewise, an uncommonly ineffective performance 
in a specific job activity is an impressive and/or decisive incident of 
performance qualitatively below those usually- observed. 

With this in mind, turn to the sample of a JPQ Als'SWER SHEET on page 13, 
Under each JOB ACTIVITY are three columns - (a), (b) , and (c) . Notice that 
under "Using Reference Materials", column (a), the estimate of the total 
number of uncommonly effective (UE) performances observed during the past 
two months for EM3 Tom Henry Jones was two. That is, the supervisor, EMC 
Abner Smith, estimated that altogether he observed two impressive incidents 
of performance for EM3 Tom Henry Jones which were qualitatively above those 
usually observed. Similarly for column (b) , the supervisor's estimate of 
the total number of uncommonly ineffective (UI) performance is one. Dis- 
regard part (c) for the moment . 

The estimates recorded on the JPQ ANSWER SHEET will be machine pro- 
cessed and must be accurately recorded. The sample on page 13 together 
with the following table, illustrates the correct procedure for recording 
one-digit numbers (numbers 0 through 9), and for recording two-digit 
ntimbers (numbers 10 through 99), in various positions on the JPQ ANSWER 
SHEET. Review the table in conjunction with the page 13 sample. 

JOB ACTIVITY ^o. of UE No. of UI 

Using Reference Materials 2 1 

Equipment Operation 10 5 

Electronic Circuit Analysis lA 12 

Personnel Relationships 0 0 

Electro-safety 0 2 
Ins true tion 

Electro-repair 2 1 

Electro-cognition 1 1 

NOTE: If the man has not had an opportunity to perform a particular 
activity, leave that job activity unmarked (as shown for "Instruction" on 
the sample JPQ ANSWER SHEET) . 

If he has had an opportunity to perform a particular activity, but has 
not shown any uncommonly effective or ineffective performances, enter a 
zero (0) for both UE and UI (as shown for "Personnel Relationships" on 
the sample JPQ ANSWER SHEET). 
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While observing a technician perform any of the eight JOB ACTIVITIES, 
you, as his supervisor, may have had many objectives in mind which you 
felt he should be striving for. However, for the purposes of this trial, 
we ask you to limit your attention to only the following fleet electronic 
maintenance objectives: 



MEANINGS OF FLEET ELECTRONICS MAINTENANCE OBJECTIVES 

1. Readiness 

To maintain efficiently self, subordinate personnel v equipment, 
and systems in state of readiness consistent with fleet requirements. 

2. Performance 

To complete any given mission in minimum time with appropriate 
level of accuracy and reliability. 

3. Operation 

To obtain optimum system output when equipment . is operated, i.e.» 
output characterized by precision and variability appropriate to mission, 

4. Safety 

To carry out duties with maximum protection for men and equip- 
ment consistent with mission. 

5. Preparation j 

To prepare for personnel requirements of present and future equip- 
ifient, systems, and situations through use of training programs, maintenance 
of high morale, etc. 



After recording the estimates of the number of UE and UI perf oirmances 
for each of the eight JOB ACTIVITIES , complete the JPQ ANSWER SHEET by 
placing, in column (c) for each job activity , your reply to the following 
question: 
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QUESTION (c) Considering this man's overall performance, it is 

your opinion that the importance of this job activity, 
as a factor in determining the overall performance of 
this man, is best described as being: 

3. of central and primary importance 

2. a significant factor, but of secondary importance 
1. of only moderate importance in estimating overall 
performance 

0. of little or no importance • 

On the sample JPQ ANSWER SHEET on page 13, QUESTION (c) was answered 
as 2, 3, 3, 2, 1, 0, 2, 3, respectively for each of the eight JOB 
ACTIVITIES. For this particular man, his supervisor felt that the job 
activity, "Equipment Operation," was of primary importance as a factor in 
determining the man's overall job performance, 

***** 

Answer the following questions in the block marked QUESTIONS in the 
lower corner provided on the JPQ ANS\^rER SHEET. 

QUESTION (d) You were asked to recall the nu^nber of UE and UI per- 

formances that you have obsv^rved for this man during 
the past two months . You teel that a reasonable time 
span for evaluationV^^ould be:. 

1 . two months 

2. six weeks 

3 . four weeks 

4 . two weeks 
5« one week 

QUESTION (e) What degree of confidence have you that your estimated 

number of UE and UI performances for this man are very 
close to the actual number of such performances that 
occurred during this time period? 

1. My estimates are probably very close to the actual 
numbers. 

2. There may have been a few UE or UI performances 
more or less than my estimates. 

3. Cannot be too sure about my estimates. It was very 
difficult to recall UE and UI performances. 

4 The aQtual number of UE and UI perf oiirmances could 
be very different from my estimates. Recalling 
these UE and UI incidents is too difficult to have 
any confidence in such estimates. 



ERLC 



11 



QUESTION (f) Aside from his performance, to what extent are this 

man's efforts on the job devoted to tasks and 
activities directly related to his rating? Compare 
this amount of rating-related activity Ko the average 
for men in his rating and paygrade. 



1. Involved in definitely more rating-related 

activities than is usual in his rating and paygrade, 
*^ 2. Involved in about t he same rating-related 

activities as usual in his rating and paygrade. 
3. Involved in less rating-related activities than 
is usual in his rating and paygrade. 

The above questions were answered as 2, 1, and 3 respectively on the 
sample of the JPQ ANSWER SHEET of page 13 of these Instructions. 



* * * ★ * 



Finally, place your social security accoun'. number in the block pro- 
vided. Also be sure to record your name, rating and rate, ship and its 
current homeport location, date, and the name of the man you are evaluating 
at the top of the JPQ ANSWER SHEET. 
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PROBLEMS IN CALCULATING RELIABILITY RATIOS 

t 

The purpose of this section is to examine the frequency with which 
the two cases: 

^ 1 . a technician did not work at a job activity ,* and 

2. a technician received ZUE = 0 and EUI = 0, 

occurred for each rating and job activity across all 21 ships participa- 
\ ting in the project. From this one can infer on the extent which any 
convention for estimating performance in those cases would affect indivi- 
dual SRE, PRE, and GRE values. 

Refer to Table E-1 on page E-4. Each square in the table represents 
the number and proportion of technicians by rating who did not work at a 
particular job activity or received ZUE = 0 and ZUI = 0 by their super- 
visor. Therefore, on job activity Number 1 , 25 of the EM's (or 25.8% of 
the em's) evaluated either do not work at that job activity (Using Refer- 
ence Materials) or received = 0 and ZUI = 0. This may seem a toler- 
able level of occurrence of such cases, but when the proportion of such 
cases exceeds .33, one should begin to consider whether the performance 
of some individuals is due more to the convention that must be adopted 
rather than to the individual's own job effectiveness. Of the 64 squares 
in the table, 42 squares had one-third or more of the men in some rating 
falling into the two cases for some job activity, '25 squares had one-half 
or more o^ the men in some rating falling into the two cases, and most 
critically, 6 squares had at least 75% of the men in those cases. The RD 
and RM ratings were particularly notorious for this type of situation 
occurring. No rating seems to be entirely free of this situation for some 
job activities. However, some ratings significantly demonstrate this effect 
for many job activities. 
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TABLE E-1 

NUMBER AND PROPORTION- OF TECHNICIANS IN PROBLEM AREAS 



Job 
Acti 

1 

2 



Rating 



Y EM 


ET 


FT 


IC 


RD 


RM 


ST 


TM 


29 


3B 


9* 


9 


90 


93 


49 


6 


0.258 


0,220 


0,364 


0,159 


0,36Q 


0,387 


0 ,296 


0,194 


23 


47 


49 


y 


93 


42 


49 


13 


0,237 


0.272 


0,318 


0 , 1 2 1 


0,381 


0 , 3fi7 


0,296 


0 , 33 3 




49 


79 


IB 


133 


iC4 


69 


26 


0.433 


0,2*0 


0,487 


0,310 


0,997 


0,149 


0 ,494 


0,667 


43 


• 3 


93 


27 


79 


77 \ 


76 


10 


0,443 


0,480 


0|604 


C ,466 


0,940 


0,982 


0,900 


0,296 


23 


83 


80 


7 


76 


90 


62 


11 


0,237 


0,480 


0,919 


0,121 


0,947 


0,3*9 


0.408 


0,282 


90 


116 


119 


39 


100 


80 


90 


20 


0,919 


0.671 


0,747 


' 0,«03 


0,719 


0,642 


0,992 


0,913 


la 


48 


83 


9 


137 


128 


76 


29 


0|lt« 


0,277 


0,939 


0,084 


0 993 


0 ,934 


0,900 


0,641 


99 


48 


64 


19 


132 


ii4 


61 


22 


c,3ei 


0.277 


0|416 


0,207 


0,990 - 


0.832 


0.401 


0,964 


Number of Men Each Rating 












97 


173 


154 


58 


139 


137 


152 


39 



4 

5 
6 
7 

8 
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THE ADOPTION OF A CONVENTION 
FOR EACH JOB ACTIVITY AND RATING 



This section discusses the findir^g that no convention can be adopted 
per ship that will account for those cases in which a technician either 
does not work at a particular -job activity or received SUE = 0 and 2UI = 0 
from his supervisor. As an example, 'observe Table F-1 . This table is of 
the same type as t^-dt previously reported on for all 949 men participating 
in the project (Appendix E, Table E-1). However, Table F-1 is reporting 
on only one typical ship out of 21 ships in the project. For this ship 
there, were 8 (out of 64) instances where one of those two cases occurred 
for al 1 men in some job activity and rating. The other ten ships at 
Location No. 1 demonstrated 16, 7, 8, 10, 13, 12, 5, 5, 5, and 16 (out of 
6<'0 Instances. -The 10 ships at Location No. 2 demonstrated 1, 16, 5, 15, 
7, 8^ 16, 14, TO, and 15 (out of 64) such instances. Therefore, it is 
impossible to form an average estimate (or some composite value) per ship 
for each rating and job act-Jvity because, in some ratings and job activities 
on all ships, there are no technicians who received either EUE or ZUI 
different from zero - 



Derivation of Composite Reliability Values 

In order to overcome the aforementioned problem, the convention employed 
in the report was to develop a composite reliability score to estimate 
technician performance on those job activities in which the technician re- 
ceived EUE = rUI = 0 or did not work at that particular job activity. 

Let ZUE(i,j) be the sum across all ships at a location of all ZUE's 
over all men in the i rating and jtti job activity. Similarily the sum 
of all ZUI's is calculated; denote this sum by EUI(i,j). The composite 
reliability score for the i^^ rating-arid j^^ job activity is defined as: 

R(i,j) = J:uE(i,j)/[z:uE(i,j) + zui(r,j)]. 

This particular estimate of job performance provides an "expected" level 
of effectiveness for a technician in the i^^ rating and jth job activity 
(for ships at a particular location). Table F-2 gives the resulting com- 
posite reliability values (R(iJ)) for each rating and job activity at 
each location. For example, from Table F-2 and men at Location No, 1 
(Cruiser-Destroyer Flottilla NINE), R(l ,3) is the composite reliability 
value for EM's on job activity number 3 - Electronic Circuit Analysis - and 
is given by R(l,3) = .8465. Reiterating, it may be said that for all EM*s 
at Location No. 1 who have not worked at job activity number 3 or who 
received SUE = 0 and ZUI = 0 for that job activity, their reliability 
ratio for that job activity is expected to be r3 = R(l,3) = .8465. Simi- 
larly this procedure is employed on the other ratings and job activities. 
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The composite reliability score is an estimate that always can be 
derived when many ships are involved. However, it does not overcome the 
implications of the results discussed in Appendix E and their subsequent 
effect on the estimates SRE, PRE, and GRE. 
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TABLE F-1 

NUMBER AND PROPORTION OF TECHNICIANS IN PROBLEM ARIAS ON A PARTICULAR SHIP 



8 



EM 


ET 


FT 


IC 


RD 


RM 


ST 


TM 


4 




5 


0 


0 


9 


0 


""1 

0 


>. ' f 7 




r' . <. 1 7 


0. 0 




r, , <^ 0 


C . 0 


0. 0 


6 


n 


7 




0 


<? 


0 


1 






r . S 8 -J 








0 . 'J 


J . ? T 


5 


u 


7 




0 


10 


0 


9 


C . 3 3 






>; . 1 6 7 . 


n , n 


1 . n n n 


0 . k '. 




6 


:e 


1 0 


3 


' ■ Q 


9 


0 




I. . 




0 . « J 3 








_ 




t 




8 


0 


0 




0 










0 , -) 












?i 




0 




1 0 






• . 0 iJ 3 


c . 




- 


0 . 0 


1 . 1 0 


j ....... _ 


5 


1 : 


. ^ 


1 


0 


9 


J 






3 . 7 <y 


I . •">■■ 


). 1 6 / 






J , U 




6 


16 


a 




0 


1 0 


0 




1 






1 O.K,? 


n. 0 


1 . 0 f 1 0 


0.0 





Nunber of Men Each Rating 

■ 6 29 12 6 0 10 0 13 
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TABLE F-2 
COMPOSITE RELIABILITY VALUES 



Location No. 1 



Job 
Activity 


EM 




ET 




FT 


Rating 

IC 


RD 




RH 


ST 


TM 


1 


0. R770 


0. 


6B31 


0 


.71*^0 


0. 7U65 


0. 


.0257 


0 


.OMO 


0.P537 


0. 7333 


2 


0.9050 


0 . 


7733 


0 


.7802 


0.8217 


0. 


lin 


0 


.Otj07 


0.8899 


0.81fi5 


3 


0.8U6S 


0. 


6932 


0 


.73U0 


0. 7081 


0. 


.0000 


1 


. 0000 


0.8662 


0. R667 


<i 




0. 


5987 


0 


.7890 


0.7692 


0, 


,0^00 


0 


.«»6?1 


0.89*^0 


0.7733 


5 


0.900U 


0. 


7706 


0 


.9107 


0. 78R5 


0. 


,001? 


0, 


.971? 


0.915'i 


0.72RU 


6 


0.93^5 


0. 


8ti81 


0 


.8U35 


Q. 8039 


0. 


,OR77 


0, 


.9877 


0.S571 


0. 897U 


7 


0.8981 


0. 


7872 


0 


. 8701 


0. 8163 


1. 


,0000 


1, 


.0000 


0.9078 


0.8269 


8 


0. 87UU 


0. 


7097 


0 


.7771 


0. 8105 

Location 


1. 
No. 


0000 

2 


0. 


.99Uq 


0.8571 


0.7U19 


Job 
Activity 






ET 




FT 


Rating 

IC 


RD 




RM 


ST 


TM 


1 


0.9101 


0. 


7203 


0, 


.8552 


0.7879 


0. 




0. 


^«351 


0.85U7 


0.S806 


2 


0.8962 


n. 


7110 


0. 


. 8R0S 


0.8673 


0. 


<*017 


0. 


, 8673 


0.8567 


0.8095 


3 


0.83U2 


0. 


7803 


0, 


. 8673 


0. 7719 


1. 


0000 


0. 


, 81»02 


0. f 


0.090q 




0.9586 


0. 


672^ 


0; 


,8167 


0.<5333 


0. 


821U 


0. 


, 82U0 


0. 7950 


0.7317 


5 


0.8987 


0. 


821(lt 


0, 


.9032 


0.9718 


0. 


86U9 


0. 


,9667 


0.9135 


0.6000 


6 


0.9530 


0. 


7368 


0 


.9231 


0.8095 


0. 


7975 


1. 


.OOOC 


0 .6759 


0.8333 


7 


0.9«*Jtl 


0. 


7866 


0, 


.8810 


O.Z2Ut) 


0. 


0000 


1. 


.0000 


0.81U8 


0.57H» 


8 


0.9120 


0. 


7918 


0, 


. 8827 


0.8267 


0. 


7059 


1. 


,0000 


0.8357 


O.Jil67 
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APPENDIX G 

A FEW REMARKS ON 
CURVILINEAR REGRESSION 



ERIC 



THIS PAGE IS BLANK 



G-2 



ERIC 



A FEW REMARKS ON CURVILINEAR REGRESSION 



Let Y be a criterion variable and let X be a predictor variable. If N 
is the number of observations on each of X and Y, then = [Y,, Y^] 
is the row vector of N observations on Y. For a given matrix >4' will be 
the transpose of A. In particular one wishes to establish a repression equa- 
tion for a particular tesponse Y in terms of the variables X, X , X ; i.e, 
it is desirable to establish which of the three power curves (linear, quad- 
ratic, or cubic): 



Y = i: &. X^ p - 1, 2, or 3 

best fits the observations obtained on X and Y. The above equations^ in 
terms of the sample observation vectors, can be expressed in matrix nota- 
tion as: 

Y ^ XR E 

where was defined above. The. matrix X. = [J, J^r. , X^^^ ;f ] where 
e/* = [1. l]i^fj and .y: = [x], Xyj] for i ^ 1,'^2, 8r 3. There- 

fore is an N x' 1 column vector of observations on the predictor variable, 
6* = [Bq^ 6 ] is the vector of p + 1 regression parameters. ^'=[e, , . . , ,e..] 

is the vector of^errors due to lack of fit in the particular model, On^ 
wishes to estimate B such that the error sum of squares is minimized. In 
particular a least squares estimate T of 6 is given by 

^ -1 

B = {X'X) X'Y 

provided the square matrix X is nonsingular and the regression problem 
has been properly expressed. The usual assumption one makes is that is 
distributed with mean [0, ^-^ixN variance-covariance matrix a^I 

where I is the Identity matrix. The term is called the common error va- 
riance of the observations. The assumption of normality of the error vector 
is not required in order to obtain the least squares estimates for any of 
the parameters in the regression equation. Because any assumption of 
normality for E implies that the observations on X or Y are normally 
distributed, this report will only be concerned with least squares esti- 
mates* One cannot in general discuss normality on X or Y because of some 
results in this report where it is shown that the distribution of TP scores, 
SRE, PRE, and GRE are not normally distributed (see Table 17 and page 21). 
Therefore it is imperative that the reader be aware th^at while the assump* 
tion of E being normally distributed is not required in order to obtain B', 
1t is required in order to make tests of hypotheses, as contained in an 
Analysis of Variance Table. These tests are the usual t- or F-tests and 
they cannot be applied validly to the sample data collected at either loca- 
tion nor on the combined sample consisting of 949 technicians for the varia- 
bles SRE, PRE, GRE, and TP score (see, for example. Draper and Smith [7], 
page 59). 
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A Least Squares Analysis of the Sample Data 

It is possible that a least squares analysis can be attempted in- 
dependently of the distributional properties of the criterion and pre- 
dictor varif?,bles. For a particular predictor variable (X) and criterion 
variab'^e (Y), the multiple correlation coefficient (R^) provides a measure 
of the proportion of the total variance about the sample mean for the 
criterion variable explained by a particular regression model. The term 
R2 Is defined as: 



r2 



Sum of squares due to regression - Sum of squares due to 
Total (corrected) sum of squares 



It should be clear that the larger r2 is, the better the fitted equation 
explains variance in the criterion variable. Furthermore, 0 < R^ 5 1 , 
and therefore R = 1 implies a perfect fit. However there are a few prob- 
lems with this approach (see, for example Draper and Smith [7], page 63). 
One must weigh the value of R^ with the least squares estimate (s2) of the 
common error variance (a^) where 

s^ = residual mean square 

= (y'y - ^) / (N - p - 1). 

Of course, the smaller s^ is for a particular model under consideration 
the better the model fits the data. Therefore the approach is to weigh 
increases in R^ with decreases in s^ in order to arrive at the best least 
squares model for the data. 
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TEST MEANS *ND STANOAflC C6VlATir>M5 

2 SOU*c 0.21* 0 ^66 

3 X CUfE O.l'i'. J 2tb 

I X i.OOO : .^J5J 0,6^7 0.055 

? SOUAR i Uffl O.V^J , 0.032 

5 1< CUBE 0 .687 0 .96J 1.000 O.OJ* 

^ Y o.05:i o.03/» 0,05^ I.OOO 

M»^ST. $fcC!;M:. ^NH T m 1 1 D ntC^ltt »*flL vnBh 1 A ^,5 , 

^Jt^JPLf fJ • 0.055 
N.O.r,! ■ i 

» fSH ANAtTSiS er VARIANCE 8N H i 

C9\TflIduT leKiS MvjLTtPLE CORRELATISN 

AND PEGr^FSSlPN FACTBfl uaADlNGS, 2ND C9LUKM) 

I * O-OO-J I'OOO 

SQUAWED firiA wElGMfS 

O.OOJ 
b .«£1GMTS 

0 . J9/ 

j»irfftc£PT C9^s^*»»r « 5,?i» 

f^UuMPLE 0 SitAHE « 0,007 
^lUL^lP^UE R « 0.086 
N.'J.r.l I 2 
N.J.r.2 a 948 

\ FC« ANACTSIS DF VARUKCE 6N R « 3,5J? 
dE wE I GkIS 

0,26^ -0.220 
C^NTfllSuTltvS T»* MjUT/fLE Cg»RELATI«W 

ASO PtGWESSl!?s FACT6R LBADlNT.s, 2Nu C8UJMH) 

1 * 0 . 01 < C • 

2 rSLAR lO.OO' 0.372 
SQUARED BEIA taElGMTS 

0.070 0.04B 
b -EIGHTS 

1.912 -a, 783 
iN-FRCfcPT r'^NjiANT • '5.091 

s r X : I £ s t 1 1 i = I J s X s » « 1 1 X • J I : s 1 ■ 1 1 r B I * « a ■ ■ ■ 1 1 s ■ ■ s t s i a > ■ s i ■ ■ i ii t ■ ■ 

MULTIPLE B S;u*RE • 0 , 043 ' ' 

'tULtlPLE R » 0.207 
•y. D.F.I ■ 3 
N.0.F.2 » 

f FBR ANAtYSlS OF V*HUNCE 6^ P f i4,09l 

rtE TA wElGi- TS ' " 

1,492 -3.62? 2.276 
CQSTR Ibul I £NS n 'ULTIPIE CeRRELATIBN 

AND RECRESSlas FACT8R L9Ai;iNCS, 2ND C81.UMN) 

I « 0.0*2 0*265 

? SOtAR ■0.316 0,15S 

3 t 0.077 0.164 
SQUARED ti wElGwrS 

2>226 13.197 5.179 
B -EIGHTS 
IJ,603 •29.45? 20iiai 

iNiERctPT ce^:^»NT • 4.669 



A\3VA fAet^ rSR P0LriV6HI,Lj 

RcDycTieK nee re linear r\x, wrrw i df . 0,003 

ftbSlOgAU 5.S, . 0,997 DF • 947 RE3I0UAL, H.S. ■ o.OOl 

f FeR LINEAR FIT • 2.650 / v . OiOO\ 



X : : a 



RfcDuCTlBK DIE T8 GENERAL QUADRATIC FIT UITU DF 2, • 0.007 

RISIDUAL 5.5. . 0,993 DF « 946 RESIDUAL • 0.001 

F FRR OlJAC^AlIC FIT • 3 .537 

^vEOUCTieN CUE T3 OUADRATjr 7£RK AL8VE, W|7H t DF, ■ fl,004 

F rfIR OuACHAIlC TERI4 AL^NE t 4,2l5 



s : « 
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HFOUCTlfIS CUE ra general COetCriT MfTM^r • o;843 
HFUUCTlfJN P.S. t 0.014 
RtSIDUAl S.S, • Q,957 OF • 945 RESIDUAL N.S, . 0,001 

.-^ ' FQR CFNpRAL CUBIC FIT • 14,091 

V JDUCTlflN CUE Ta CU«JC TgRM Alt#^E j-lT« 1 OF • , 0.035 U T 

few Cubic term al«ne • 34,943 ""-^ 



« • 

TP 



SC8flP« 949 ODSFSVAt I INS, 



TEST MtANS ANC STANDA^^C OnVUTlQNS 

1 A 0.t)5» 0,4C7 

2 nuijAf; 0 . 477 o.jsa 

5 •< CV66 fl.42fl 3.J7/ 

* T •>. 353 2 ,ZiO 
CaSRELATlCK J-aTQIX 

t X l.OOO 0,976 0,934 0,100 

2 '^OUAfl 0,97« l.QCO 0,999 0,06J 

5^ * Cl,E£ fl.9J^ 0.98'? 1^ 000 0,036 

* y &.1O0 0,0*3 0,036 1,000 

M^Sr, StCtSC. ThIRC) QtCflFE alS» 

^. J. r .2 I 947 

f fGfl ANALYSIS or VARIANCE 8N R « 9,974 
BETA weiChTS 
0.100 

Ce-<T«IBuT I£NS T9 MULTIPLE CORHELATUN ' 

ASO fltCHESSlQ'* FACreR LSADINGS. 2ND CaUUHS) 

1 * 0*010 1<000 

S^JARED BETA WEIGHTS 
0.010 

9 -EIGHTS • 
0.576 

INTERCEPT CONSTANT « 9,028 

s===ss:rts3zxsiTsxit=titi=:T|iiita>iii**-*iiiisiiai33i>9iiiziKi*iaiiaxii««i 

HulTIPLC B S;u*R€ • 0,036 
-hulTiplE a I 0.189 
N . 0 . F .1 « 2 

N.0.F.2 I 946 i 

r FBR ANALTSIS 9F V*R1A»<CE R • 17»109 
UETA hElGhTS 

0.617 -0.734 
C^N^a J But IGnS TJ^ multiple C9RReLATl»N 

AND REGHESSias FACrsR LaAOINGS, 2ND cenjHH) 

1 A 0 .082 0-530 

2 SQlar 10.046 0.332 
SQUARFD BETA -EIGHTS 

:.667 0.53* 
8 HflGMTS 

4.700 -4.431 
iNtfRCEPT CONSTANT « 4.«]S 

t3£riS^7lt3-ttlltl|tl3>t|t3BlaBg|,jiaill|«ia|l|ai|g||a||ax«8l||gga^BBajl«la 

MULTIPLE fi SCUARE • 0,036 
f-J^MPlE P > 0,169 

N.o.r.i • 3 

N.U.f'.S • 9 49 

r FciR ANALTSIS (?r VARIANCE H » lli665 

6EIA WEIGHS 

3.^54 -g, 5 79 - 0 . 099 

;:n\'fiia'jT j£NS Tq MULTIPLE CftRRELATUN \) 
AND RECHESSJ9N fACTflR leADINGS', 2ND CflUJMN) 
1 t 0»o75 0-52' 

? 5CLAP ■0.036 0.332 

3 v C^^t iO.OOS 0.192 
^OjaQED et I a w£ IGHT9 

C,33b O.OOt 

B HEIGHTS 

4,341 -3,495 -:,990 
INTERCEPT COKSTAST ■ 4,641 



AN^V* TABLF FfR PaLvsenjALS 

qtCoCTlEi, CLE T8 LINEAR rjT, iiUw I Or » 0,010 
J fOH LtSEA:* FIT ■ 9^976 »«»01 

MEtiuCTIBK OLE T« GENERAL QUADRATIC FIT WtTM OT a, • 0.036 
•^EDUCMflS .S . • 0 .OlB 

RtSIDUAL S.S, ■ 0.964 OF * 946 RESIOgAt • Q.OOl 

F F^R OUACHATIC FIT ■ 17,906 

itCjuCTlflN tu6 T« QUADRATIC T£Rh ALSk^E, W|TH I OF, | 0,026 
r Fr>H CUACRATIC TEMH AL9NE i ?9,i99 
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-JEUOCTIQS Cue TB QfeNfcRAU CUBIC TIT WITH Of 2, » «;036 
'*EbUCT |(3N H .5, • 0.0l2 
nt^ilDUAU S.S, ■ 0,964 Of ■ 949 RESJDUAL H.J. m O^OOl 

^ ftR GENERAL CUBIC FIT • 11,669 U A 

UCTIOK LuE Ta C'jaiC TERM ALfNE WITH 1 QT | , ' OrOQO 
RH CUBIC »ER« ALONE • 0,OU 



*^ / 
IF^ST MEANS AND STASOAno ficVUTl^NS 

SQOAK 0.879 • 0.177 

3 A CIEE 0.839 0.210 

^ Y 5.350 2.J40 
CO««£LATteh ^Atfllx 

^ ^ i.OOO " 0.956 0.89^' 0 0P7 

2 SO'JAfl 0.956 1. 000 O.^^A O.O^l 

3 « CLEe ^1.895 0.V86 1,000 0 077 
* ^ O.Ofi? O.Oftl 0 . 077 l»'oao 

»*ULTIPt-g P SCUAPE I 0,008 ■'.■aj. 
HULT|PLe P = 0.087 
^.O.F .1 J 1 
^.J.F.2»^ 9<7 

f fpj? AsuTsis er yARiAKce r i 7.161 

rfETA wklGhTS 
0.087 

C9nT;^I8uT !£SS T9 NyLTlPLE CQRR6LATI8N 

AND ^^£G»ES5i^^^ TkZTz^ l3A01N<7S, 2w0 C«IUHN; 

1 * 0.038 x.qoa 

a. 008 

9 WEIGHTS 

1.400 <r 
iNTERCEPT CONSTANT ■ 4,053 

hultjple fi scoAfle I 0,008 ■■■■■ 

hUl^IPLE P ■ 0.087 

N . 0 . r . 1 « 2 

*i,0.y,2 t 94ft 

fe« ANALYSIS er variance « « 3,989' 

0.103 -0.017 

cesTRSB-jne^s ra multiple cfiffRELATieN 

kUU REGRESS19N FACTfiR L6ADINGS, 2ND C9LUM^) 

1 ^ 0 * 00? Q ,999 

2 S3LAR »0»001 0.937 ^ 
SQUARED bETA taElQMrS ^ 

O.DU O.COO ^ 
8 i.EIGMTS 

1.6*3 -0.225 
INTERCEPT C<3NsTANr • ^4,00* 

;c"!pLrr«::;ri'"":;o;"*"'"' 

MUlT|PLF fl 1 0.094 

N .o.r ,1 • 3 

N.O.T.Z I 949 

» FGR A»iALt5lS or VARllNCE AN fl f 2,791 
.BETA wElGKTS 

0.661 -1,542 i.003 
C3NfftjBuTieN5 Ta ►MULTIPLE CefiRELAT!»r< 

AND P£C»5SSIG?V fACr«R LflADrNGS. 2n') C«HJHV) 

1 * 0.037 0.923 

2 SClAR ,0.125 0.867 

3 X C^.QE O. 077 0 . 816 
SQUARED BE T A wE IQMTS 

0.438 2.378 1,010 
B nEIGHTS 

10,690 -20.332 11,213 
INTERCEPT CONSTANT t 3,9X4 



ANSi/A TABLF F6i^ PeLT^e>*lAUS 



ftbDUCneK DIE TS LINEAR riT| hlTW 1 OF . 0 . 008 ' " "•■•«■ 

RESIDUAL S.S. t p. Df • 947 REIIDUAL H.S. ■ 

f jeR LINEAR riT * jf^i^t ' *^ O«0ffi 



REDuCltSK Die f$ GENERAL QUADRA TiC.r r 7 HtlH OF 2*j ■ 0,008 
hEDUCT!p^N »-.S, ■ 0.00*4 
RfcSiOUAL S.S. . 01992 or > 946 «E3I0UAL H.S. • 0 flflt 

HEOUCTinN Cue T9 QUADRAftC TERH AL8NE, WjTH 1 DF, | (1 000 

f FBH Oi;ACRATIC TERH A^^flNE ■ o.02< * u I w n.guo 

t^EOUCTlQh CUE 18 0£NERaL CU9IC TIT WITH Of 3» ■ o:D0» <r" 

REoucne^ .s, ■ 0.003 * 

RESIDUAL S.S, > 0,991 or < 945 HESICUH H.3, « 0,001 



/J - rflf» cpNEftAL Cubic tit ■ 2.798 a ■ » u c 

|;^[^(^ FOR^CuaiC TERH A1.ONE . 1,215 ^ 



i'JuVNRHlAl. FiTltNO TQR 2- V AH 1 APL? S< wRfc ASO t I;C^^^E. * 9-* V 0q SF« y A f [ INS , 



TME Pf?bDlCie« V*H!ABUE(X) |5 HfiF, A^D THE CRlTErtlfiN VAqiAfit8CY, I ^ TP SCe«6; 



TEST MEANS AND SIANRARO DEVIATIONS 
I X - - 

? SOUAR 

3 X cueE 

^ Y 

CeRREUATieN MATRIX 
L X 



0.603 


0.204 




O.<05 


0.231 




Q .390 


0.227 




>.350 






1.000 


0.970 


0.9213 


a. 970 


1.000 


0 ,9fl6 


0.920 


0.986 


l.OOQ 


0,257 


0,2*7 


0,2?9 



0,257 



2 SOUAR tf.y^o 1.000 0,9fl6 0 2*i 

3 X CCEE a.92Q n oAik « 



0.2?9 

i.ono 



n^;;r;Ece^c: :^r;H;5S'SeGSErp;:;;;H^ 

MULTIPLE R « 0.^57 
N.O.F ,2 ■ 947 

f reR A^/AcYsis er yar:ance sn a « 6T,oi7 
aerA heickts 

1 0,267 

C9NTR|Biir le^jS 19 MULTIPLE C9RBELATI9K 

AND RfcCRESSI9S FACT8R L9A0INGS. ' 2KD CBLUMM) 
1 ^ 0.0** 1.000 

SQUARED BETA WEIGHTS 

0. 066 
B WEIGHTS 
2.950 

«o:np:rrsc;:Rr:'"":5:r'' 

J^ULTIPLE R ■ 0,257 

O.F.I ■ 2 
N.0.F.2 ■ 946 

r F3R ANALYSIS SF VARIAKCE AN H I 33,5tf 
8ETA gEICHTS ' * 

0.294 -0^038 
C9NTR|puTie»jS Te MULTIPLE ceRRELATISN 

ANO PECHESSles fACTSR L$AOIhCS, 2N0 C«LUHM» 

1 X 0.0?* 0.999 

2 SQUAN «0.009 0.961 
bQuAReO BETA WEIGHTS 

0.086 0.001 
8 WEIGHTS 

J. 371 .0,384 
INTERCEPT CSNSTANT • 3,473 

MULTIPLE n SCLIARE 4 0,071 ■•*■■»■■'•■■■*■•■*■■■■»*■■■•■ 

«Ui.TlPt.E R ■ 0.2*6 
N. O.F.I a 3 
N.0.F.2 ■ 949 

^ F6R ANALYSIS SF VARIANCE 8N B « 25,99? ^ 

OETA WEIGHS * 

-0.J37 1. 572 -1»0U 
CeNtR'«^UTiesS TB HULTIPLE C8fl^ELATI«N 

ANU REGfiESSI.^N FACTBR L3ADJKGS. 2ND CflLUMN) 

1 X i0.0«7 0.966 

2 SOLAR 0.369 0.929 ' 

3 t CCBE 10.231 0.699 
SQUARED 8EU WEIGHTS 

0/113 2.472 X.024 
B WEIGHTS 

->5. 865 15.953 -lOMSJ 
ISiBRCEPT C0ftSTA/VT • 4,246 



AN9VA rAEuE Fe<? PBLYN^MUlS 



: 3 c : t 



«bDuCTieh OLE T9 LINEAR FIT, hi TW t Of • 0.066 -..«-t«« 

RbSIDUAL S;S. 0,934 DF . 947 RESlDuir%.5 

, ^ ffiR LINEAR FIT * 67.017 c3»uu*L 0«OCl 

REnuCTje^ OLE TB GENERAL QUADRATIC FIT «|TM 8F 2, • 0,046 
HEUUCTION H.S, ■ 0.033 

HEDUCTION CU6 T8 OCNEPAL CUBlCFlf WITH Qf 3, • o;671 
REUJJCTI0N>.S. • 0.024' * 

«fcSltJUAL S.S. . 0,9J9 OF « 945 RESIOUAi, H,%, • 0,001 

Q ' FAR General cubic fit • 23,999 u c 

CD I/^^^^^/i^i Cue Tft CUBIC TER>! wtTK. I Of f , 0.005 ""^ 

tKl(^^»^Q» CuBlCJERH AL8NE « 4,698 



APPENDIX I 

RESULTS OF THE CURVILINEAR 
REGRESSION ANALYSIS BY RATING 
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POLYMOMlAL rtniNO FnH 2 VA«IA«Jl.f.S-13Ht AND TP SCO^E- 97 OH StPV A T 1 0N$* 



THE PRCniCTOfl VARIAflLCOt) IS SfiE» AND ThC CRTTtfllON VABUflLE(V> TS TP SCOftC 



TPST MEANS A?^') STANoaPC OEVIaTIONS 

1 X 0,413 0.302 

? SOUAA 0,?60 0.276 

.1 X CUaC 0.185 0.258 

* Y 6,000 1.953 
COBflELATlON MATRIX 

t X I.OOO 0.9*3 0,867 0.365 

? SQUAft 1.000 0.98o 0.164 

3 K CUBE 0.fl67 0.980 1,000 0 ,^?f^ 

♦ . Y 0.369 0.364 0,1211 1,000 



FIRST ^SECOND, AND ThIPiH nEGPEt POLYNOMIALS, 



MtiLTlPLE R SOiiARE ■ O.PJ 
MULTIPLE R ■ Ot36S 
N.O.F.l ■ I 

N#n,F,? ■ 95 

F For analysis or variance on r ■ 14.960 

BETA WEIQHTS 
0,365 

CONTRIBUTIONS TO MULTIPLE CORRELATION 

ANO RE0RES<%ION FAcTCR LOaDINOSi 2N0 COLUHN* 
T X 0.133 1,000 

SOUAREO 8ETA WEIOHTS 

0,133 
9 WEIGHTS 
2,358 

INTERCEPT CONSTANT w 5.0?7 



MULTIPLE R SOilARC • 0.136 
MULTIPLE R ^ 6#369 
N.n,F.l ■ j 
N.O.r,? ■ 9a 

F F(}R ANALYSIS OF VARIANCE ON R ■ 7,420 

BETA WEIGHTS 
0,196 0,179 

CONTBIHUTIONS TO MULTIPLE CORRELATION 

&N0 REGRESSION FACTCfi LOaoInOSi 2N0 COLUMN) 
I X 0,071 0.987 

? SOUAR 0,065 Ot9d9 

SOUaREO RETA WEIOHTs 

0. 038 0»a3? 
n wpioHTs 

1, ?65 1,?^6 

INTERCEPT CONSTANT ■ 5«146 



MULTIPLE R SOtiARt ■ 0.1 '6 
MULTIPLE R ■ 0.A19 

N.n.F.i • 3 ' 
N.n,i ? 93 

F FnR ANALYSTS OF VARIANCE ON R ■ 6.619 
BETA WEIOH75 
-1,120 3.77n -2,404 

CONTRIBUTIONS TO MULTIPLE CORRELATION 

ANO REGRESSION FacTCR LOADlNOSt 2N0 COLUMN) 
1 X -0,40fl 0t«»?9 

? SOUAR 1,374 0.667 

3 X cm -Ot7'30 0.783 

souareo beta wctqhts 

,255 14,276 3.779 
0 WFIGHTS 

-7,246 ?6*,715 -l8,?2l 
INTfRCEPT CONSTANT ■ 5.40* 



ANoVA TABLE roR POLVNCMTaLS 



REOUCTION DU^ TO LTNEiR fJTi WITH 1 OF ■ 0.133 

RESIDUAL S.S, ■ 0«867 OF ■ 99 REStOUaL H,S, « Ot009 

r FnR Lf^iEAR fxi ■ 14,S60 



REnUCTTON OIJ^ 70 GENERAL OUaORaTIC FIT WITH OF 2» ■ 0.136 
REOiiCTION M,S« ■ 0.068 

RESIDUAL S.S, ■ 0.864 OF m 94 RESIOUAL *<.Si • 0«009 

F FnR OmORATTC FIT ■ 7*420 

REDUCTION OUF TO CUAnHATlc'TfRh ALOnEi WITH 1 • 0.003 

r FOR OU«0R4T|C TE^»< ALONE ■ 0»375 



REOiiCTION DUE TO GENERAL CUBIC FIT WITH OF 3» ■ 0,IT6 
REOUCTION M,S, r 0.0^9 
RESIOUAL S.$, « 0^824 OF ■ 93 RCSiOUAL H,9, ■ ,0.009 



LC 



GfNCRAL ClffllC FIT • 6,6l9 
HiCTION DUf TO CUriC TCft'* ALONE I^IfH J OF ■ . 0«040 
'OR CUBIC rrPM ALONE • 4,460 



EM RATING 

TrsT m:*ns ANn sr/iNnftRo ncvtAitONS 
1 t 

? SQIJAR 

3 X CUBC 
A y 

CORRELATION Mi^TRtX 
1 / 1.000 0.<i7S 0.94? A >a7 

' fcnsE S-oH ''T '-'^ 

4 Y .'VJ ^'^a? ^'O^O "'"^ 

°'2*7 D*297 r>,32? i.fton 

rTn«;T, SECONO, and TmIbo nfOREE POLYNOMIALS, 





o,:t70 






0.539 


0.359 


4 lOOO 


1.953 


i.ooo 


0.^79 




1 .000 


0*1*2 


0.990 


0.2A7 


D*297 



■ as a I 



MDLTIPLE R SQHAOE ■ ©.O-il 
MULTIPLE R . 0.247 

F ro« ANALYSTS or VABlANCC ON R m ft^ift^ 
0.2A7 

CONTRtPUrtO^^S TO MULTIPLE COrPELATIOn 

AND PEORES«;tON FicTCR LOaqINOS^ 2N0 COLUMN) 
\ ^ 0,061 UOOO 

SOUARED flETA WEIOFTS 
O.OAl 

fl wrroMTs 

1.303 

INTERCEPT CONSTANT ■ 5.n2 



MULTIPLE R SOilARE ■ 0»133 
MULTIPLE R ■ 0.365 

N.o.r.i ■ 3 
N.o.r.p ■ 9^ 

F TOP ANALYSTS OF VARIANCE ON R • T.iiA 
BET» WEIGHTS 

.1.033 K3rt7 
CONTRIHUTfONS TO MULTIPLE CORREtAlIOw 

AND REGRESSION FicTCR LOaoINGSi 2N0 COLUMni 
1 « -0.255 o.6?ft 

? SOUAR 0.38» O.fliJ 

SOUARED nETA wElOhTS 
1.066 i,7n9 

B wriowTs 
•'5;453 7,nn4 
twTeRCEPT CONSTANT ■ 5.5i6 



MvJtTfPLt R Sotj/^RE ■ o.i33 
MUlVIPLE R - 0.365 
N.O.F.l ■ 3 
N.O.^.? ■ 93 

F FAR ANALYSf^J OF VARIANCE ON R • a.TtV 
BET* WEIflHTS 

•1 .006 1 o,6*i 
CONTRIBUTIONS TO MULTIPLE CORRELATION 

ANO REOPESStON f AcfCR LCaqINOSi 2N0 COLUMN) 
I K .0.248 0.6?* 

? SOuAR o.36» O.fth 

3 X CUBE- 0.013 '0.692 

50UAREO aETA . lOHTS 

1. 01? 0.002 
B i<FIOHTS 
-5.313 6.647 0.224 
tNTERCCPT CONSTANT ■ 5.5i5 



ANOVA TAflLE FOR POLVNOuuLS 



REPUCTtON due to linear FET, kith I OF . o.flft, 

REnUCTTrtN OliF TO OEnEPal OUaORATIC riT wiTH OF 2t ■ 0 I3i 

RFmrCTlON M.S. ■ 0.067 

PFSJ0U4L S*S. » o.fl67 OF > 94 RCSfOUAL M.<. • a 

F FnR OlIAOPATIC FIT . 7.239 '^^SIUWAL M.j. « ^.qj, 

REOilCTtON O.fF TO OUtnR*TIr TERM AL0NE# WlT-t I c^i . 0.073 
F FOR QUAnPiTrC TERM A^ONE • 7,867 

REOilCTlON OllE TO OEneHAl CUBIC FIT WtTH Of 3, . a M5 

REDUCTION M,S, . 0.0*4 

PE9I0U4L 5.S. . o.»6? OF - 93 RCJiOUAL M,i, « 0.009 

^ !J OFNCRAf. Cf.flrC FIT • 4.774 

CD ir""^'^^.^"^ ^^^^^ TEH^ ALDNE *»rTH I OF ■ , 0*000 
tiML' CimlC TfR^< ALONE . O.OOO ° 



N4 



EM RATING 

THE PREnTCTOQ VAftlAMLt(Xt IS ORE, *N0 ThC CRITERION V*n'U8LC(Y) 1% TP ScO«E, ' 



TCST ME4N^ Awn STlNOaflC 
1 K 0.940 

3 t CURE n,n9i 

* Y ft.OOO 
CORRELATtON N/ITRIX 

1 X 1,000 

? SOUAR n,99q 

? X C'JBC 0,P97 

* V 0.301 

MIJUTIPUE SniiARC ■ O.O'O 
MUUTlPur R • 0,301 
N. O.F.I • \ 

^•o^f.? ■ 9n 

F FOR ANALYSTS OF VARIANCE ON R • 9t4l5 
flETi WE^fiHTS 
0,301 

CONTRIRUTTONS TO MUlUPlc COrREIaTIOn 

AND ORORESSION FacTcr LOaOl^tOSi 2N0 COUUHNJ 
! V O.Oqo 1,000 

SOUAREO HEta weights 

0.090 
fl WFIOHTI 
n.507 

I^JTF«CCPT COMSTANT ■ -5ia43 

«UtriPLE R SnfURE ■ 0.i5« 
MUtTlPLC « • Oi393 
N,D«F,t • 2 
N«0,F«7 ■ 94 

F FOR ANALYSTS OF VARllNCE ON R • 8«5fr0 
8FT4 MtlfiHTS 
-5.9ft5 n.««9i 

CON^RIBLfTIONS TO MULTIPLE CORRELATION 

AND OFORESSION F4CTCR LOaqINOSi ZftO COLUMN) 
1 t •! ,679 O.T6« 

? SQUAR 1,833 0.T93 

SOUfiREO RETA wriOHTS 
31. 34.7^7 

8 WEIGHTS 

213. «19 123, )?3 

tNTERCEPT CONSTANT ■ 97.486 

MUtTlPLC fl SflHARC • 0.^21 
MULTIPLE » - 0,470 
^'•O.FW - 3 
N«0,F,2 ■ 93 

F FOR ANALYSTS OF VARIANCE ON R ■ 8,794 
SFTa WEIGHTS 
l?7.159»266,An9 i39.994 
CONTRreuTION^ TO ^'ULTIPLC CORRELATION 

ANO RCflRCSStON F4CTCR lO*OINOS» ?N0 COLUMN! 

i V 3fl«22i 0.639 

7f SOUAR •82,9A7 

H t CU8E 44,9A7 0.663 

SOUaPCO RETA wFIOHiS 



DEVIATIONS 
0.051 
0,093 
0.129 
1.953 



0.999 0.997 O.lOl 

I. 000 o.'99 o.lll 

n«999 1 ,000 o,y?.\ 

0«3ll 0>32i t.Artn 



0 WFIOMTS 

8A7,907««"«««»«?H7.6B1 

INTERCEPT CONSTANf ■ «U0Ot053 



ANOVA TABLE FOR POlyNCmJALS 



REnUCTTON OUF TO LINEAR FIT, WITH 1 OF • 0.090 

OESIOUAL S.S. - 0.910 OF • 95 RESIOUAL M,3, « OtOlO 

F FOR LINEAR rtT - 9.43S 



PmUCTlON nuF TO OCnERAL quadratic fit wITH of 2i ■ 0.194 
REDUCTION M.S. ■ 0.077 

REcrnUAL S.S. m „ n,ft46 OF - 94 RESIDUAL H,8, « 0t609 

F FftR OUAORATfC FIT . A<iiAO 

RKOilCTION OUF TO CUapRATic TERM aLOne. WITH I nF* • 0.064 
F FOR QUAORaTTC term ALOnE • T.Ofll 



ERIC 



wEOcrCTTON m/r to ocnf«al cuarc fit with of 3» , o 2?i 

REOllCTTON M.S. ■ 0.074 
wrstOUAL 3.S, 0.779 OF « 93 RESIDUAL M,S, • o.flOS 1*5 

^ For OCNERAL ClielC FIT • 8,794 



rOtlCTlON nuF TO CU«IC TEP>< aLONE NITH I OF • . o.aat 
FOR CUflTC IFPH ALONE • 7.9rt7 



mem 



EM RATING 

JMI PPEftlCTOf? VA»Uni.eu> IS WP(:» AMD Fh^ CMITkHION V A R T A4L£ ( V) * JS Tp SCOfiC,' ' *: 
TF5T MEANS ANn STIKTAHC OfiVUTlONS ' . 



1 X 














0,?25 
















* ¥ 


ft. 000 








CnflorLATfON 










\ % 


1 .noo 


0 ,963 






? S0U4Q 


0,<363 
















it.A^t 


* . Y 




0.50* 




1 .000 



Min TIPLP M STI4QF ■ 0.<*2 

F Fob analysis OF V4«UfJCE ON R ■ 3o»345 
flFTs wFlrtHTS 

0,40? 

CONTHlMUTlnNS TO KUl.TlPLf COPPIlaTIOn 
i 1 0,242 1.000 

0,^42 
•i. 1 94 



HUtTIPLF R SOMAPE ■ 0.254 
MutTIPLF R ■ 0.504 
^•.O.F.l ■ ? 
N.O.r.? ■ 94 

F FOR AN*LVSI^ OF VAQlAf^CE ON R • 16»024 
flFr* wei<3HT5 

o,oq«s n.4it 

CONTOlHtJirONS TO ^'ULTIPLE CORR£LATtON 

> Jt 0, 047 0.9?6 

7 SOUAR 0,207 0.999 

SOUaOEO reta -'FIOHTS 

0.009 0.rA9 
p WFTGHTS 

1.012 3.^73 
[NTrRCEPT CONSTANT ■ 3«7?8 



MULTIPLE R lOiMHE » O.JqO 
MULirPL* R • 0.54S 
►^*0,F,1 ■ 3 
N*0,F,2 - 93 

f FriR AWAcrST? OF VARIANCE ON R » 13-273 
BETA WEIGHTS 
-1 .♦75 5.100 •3.210 

C0N7»iRi;ri0N5 TO f'UL'rpLE correlation 

AND REGRC8«;rON FAcTCR LOaoINOS* 2ND COLU^NI 

\ t -0,726 0»8'i9 

7 SOUAR ?,5AA 0»9^0 

1 » CURP: •1,5a3 0,878 

souareo beta weights 

2,176 26,012 10,307 
B WF1GHT5 

•15,571 44,319 -26,^61 
INTERCEPT CONSTANT • ♦•849 



ANOV* T*«Le FOR POL>NCHtALS 



ERIC 



REniJCTION Ol/F TO LINEAR FJT, i^ITH l OF m 0*?4? 

DF«;rDUAL 5»^. ■ 0.758 OF ■ 95 RESlOUAL M,s. i O.OOfl 

F FOR LINEAR riT ■ 30.3*5 

ornuCTTON OIIF TO'OFnEBAL QUAORATIC FIT WiTM OF 2t ■ 0.254 
BFOiiCTION M,S, ■ 0.12/ 

flF«:TOUiL 5.«i. ■ fl.746 OF • 94 RESIDUAL M,s, « ^,^08 

F FnR OUAnflATTr FIT ■ H«0?4 

RFOnrTlON OUF TO CUAnflATrc TpRH ALCNf , wITm I cFi m 0,012 

F mu qi»AnR6TTC term alone ■ l.SJi' 

RFOiiCTION nur TO OENfflAc CUfllC Fir WITH DF 3, . 0,3*10 
RFOiicnON M,'^, ■ O.lOO 
REStOtJfiL S»^. • 0,700 OF ■ 93 RESIDUAL M,S, ■ O.flOfl J.g 

O For afNFPiL CItRtC FIT ■ 13.273 

"■OMCTrON nUF TO CUntC TFMt* ALONE *»lTH I OF ■ , O^O^^ 
FOR ClJMir TfRm alone ■ 6.051 



TFST MEANS ANH STANOAMO DEVIATIONS 



1 t 




O.?08 








7 SQUAR 


0.671 










■» X CUBE 










A V 


6,^IA 










CORflEtATlON 












1 t 


i.boo 


0.909 


0. 


.778 




? 90UAR 




I. 000 


S ( 


.963 


0.9O9 


3 X CUBE 


0.77§ 




I i 


• 000 


n.i26 


A V 


0.3ie 


0.?05 


n 1 




1. 000 



MULTIPLE ft SOiiAPE ■ O.Ul 
MULTIPLE fl ■ n.3l« 

N.n.fti » T 

N»0,F.2 • l7l 

r Fnn analysm of variance on r ■ 19.i9i 

BrTA WETHHTS 

CONVfllRUriONS TO MULTIPLE CORRELAFION 

aNO oEOQES^ION factor LOAOlNaSi 2K0 COLU^'M) 
I H 0,101 1.000 

SOUAREO RETA wEIOHTS 

o.tni 
a wriOHTS 

InT|( CEPT constant ■ 6.097 



MULTIPLE R SOiJARE ■ 0.1*2 
MULTIPLE « • 6*376 

N.o.r.i • 2 
N«o«F«:; ■ 170 

r roR ANALYSIS Of VARIANCE ON R ■ 14.021 
BETA WEtOHTS 
0,7^9 -6.4"^ 

CONTRIBUTION^ TO MULTIPLE CORRELATION 

aNO RE0RC$<10N rACTCR LOaoINO^i 2N0 COLUMN) 
{ M 0.241 0fA*4 

^ SOUAft •0,094 0.94S 

SnUARfiO REfA wEIOHTS 
0,976 0.219 

R wrroHTS 

A«498 •9.701 
iMTfRCCFT CONHTANT • 9*839 



MULTlPtC R SOHARE ■ 0<H2 
MULTIPLE R ■ 0.177 
N.O.F.l • I 
N*0,r.2 ■ 169 

F FnR ANALYSIS or VARIINCE ON R ■ 9i323 
BETA WeiOHTI 

0,B4f aOiTlO 0.l'9t 
CONTRIftUTlOHS TO t^ULTlPLE CORRELATION 

fNO RCQRES^tON FACTOR lOaoInOSi |N0 COUUHN) 
% 0,2*B 0tB^3 

n IQUAR aO.US 0«S44 

9 H am 0,019 0>334 

IQUlREO BETA WElQ^TI 

0.714 • 0,013 

fi ^FTrtHTS 

7.239 "B.ATT 2>i2t 
tNTrRCCPT CONSTANT ■ ^lH? 



ANOV* TABLE FOR POLYNOMIALS 



MEOUCTION Our TO LINEAR FfT. WITH \ OF ■ O.IOJ 

OESIOUAL S.4, ■ 0«K99 OF ■ l7l RlSlOUAL M,|« ■ 0.009 

F FnR LINiCAR FIT ■ 19.191 



REmicTroN oirF to oemEpal quadratic fit .ITH of 2f • 0.142 

REOliCTION M.S. • 0.071 

|jF<IDUAL S.«. • 0tH9B OF ■ 170 RESTOUAL M,S* R 0«Q09 

F FnR OlIADRATIC FTT 14,021 

RCOIICTION OUF TO CUAHRATIC TERM 4LQNEt WITH 1 ftFt 9 Ot04t 
F FnR QirAORATTC TERM ALONE ■ ll»09B 



REOtlCTION DUE TO OEnERAL CUBIC FiT VlTM OP 3i • 9»U2 
REOilCtlON M,S, • OrO^T 
RESfOUAL Sfl. • O.ASft OF « (69 RESfOUAL M,|« m 0«<|09 

v^^FoB OENERAL CUnlC FIT • 9.323 

Ml DtlCTION our Tfl CURIC TE«N aLOnE »i|TH I OF • , 0t006 
w&^rnti CURIC TFR^ ALONE • O.OTA 



POl'NO'liM. r\XJtN(] fV.M 2 VAM, AilUt^-JMC AnO TP ICn^t, 17j OH 5^0 V4 T I ON S . 



ET RATING 

THE PRtniCToa VARI/ini.ElX) Is PHEi *no The cnUpHlON VAnlA^LEjY) |1 ip ScnHCt 



TP$T MEANS 


ANO STANOAMn 


OEVI aTIONS 






1 X 


0.404 








? fJQUAR 


0 .?87 


0 .?B6 






y X c'jor 




0.2*8 






4 y 




1 .7U4 






CnRREUATION 


MATRIX 








1 X 


1 .000 


0.967 


Oi904 


0. 366 


? SQUAR 


0.967 


1 .000 


0.9fl? 


0 .161 


1 X ClIHE 


0.Q04 


O.Q»2 


1.000 


0.343 


4 y 


0.166 


0.3<>1 


0.343 


1 .noo 



rrR«^T» SfCO^n, anC TuiRn np^REE PUiyNOMiALS. 



MULTIPLE R SQUARE ■ ^ l34 
MULTIPLE R ■ 0.36' 
N.O.F.i ■ I 
N.0.F.2 • l7l 

f fnU ANALYSTS or VARIANCE Qk R * 26.423 
QFTi WEinHTS 
0, 366 

CONTRimiTIONS TO ►'Ul.TIPLE CORRELATION 

ANO oFaRE«;';iON factor loaoIngsi ?no coluhn) 

\ X 0.134 1.000 

souareo beta wetohts 

0. 134 

R WFlOHTS 

1. fl54 

IN/EXCEPT CONSTANT • 5.765 



MULTIPLE ^ SQUARE ■ 0.135 
MULTIPLE R ■ 0.367 
N.O.F.I ■ 2 
N.J.F.2 m 170 

F FnR ANALYST^ OF VARIANCE ON H ■ I3t222 
BETi WEIGHTS 

0,J?60 0.irt9 
CONTRIflUTIONS TO ►'ULTIPLE CORRELATION 

aNO PEORES'ilON Fir.TCR lOaOINOS? 2N0 COLUMN) 
} X 0.0<3^ 0.997 

? SOUAR 0.039 0.984 

SQUARED flETA wFlOHTS 

0.n6f) 0.012 
fl WFIOHTS 

1.319 6.677 
INTERCEPT CONSTANT ■ 5.797 



MULTIPLE R SQUARE ■ 0.135 
MULTIPLE R ■ : 0,367 
N.O.F.I ■ 3 
N.O.F.? ■ 169 

F FOR ANALYSTS OF VARIANCE ON R • 8.769 
BET* WEI0HT5 

0.364 -0.n7 0.l4e 

CONTRIBUTinNS TO ►'ULTIPLE CORRELATION 

ANO REGRESSION FArTCR LOaqINOS* 2N0 COlUHn) 
T X 0.133 0.9*7 

if souAR -0. 049 0.983 

1 t CUflr 0,051 0,935 / 

■SOUiREO BETA wEIOHTS 

0. 133 0.019 0.622 

B WFIOHTS \ 

1. Q4S -0.fl47 1.068 

Intercept constant • 5!783 



anqva table for polvncmials 

oEnucTiON our to linear fIt, with i of ■ 0.13A 

RESIDUAL S.S, ■ 0.ft66 OF * 171 HESlOUAL M.j, ■ o,o05 

F FOR LINEAR FIT ■ 26.423 



RfnUCTiON OlJF Tn GENERAL QUADRATIC FIT WITH OF 2, a 0.135 
REOUCTION M.S. ■ 0.067 

MESinUAL S.S, . n.R65 OF • 170 HESlOUAL M.S. • 0.fl05 

F FOR'OUAORATIC FIT ■ l3«??2 

REOilCTlON OUF Tn CUAhRATlc Tj>RM ALCnEi WI^M 1 pFi t O.OOl 
F FnR QUADRATIC TERH alOnE ■ 0.152 



ERIC 



REOuCTinN nuff Tn oenerai. Cubic fit with of 3, • o,r^5 

RfOUCTinN M,s. ■ 0.043 

^RESIDUAL S.5. • 0.fl65 OF • 169 RCsTDUAL J^.S, ■ 0.D05 I "8 

iR 0E»jER*1. cubic fit ■ 9,769 

ICTION nUF Tn CUBIC TE«H alone il»TM 1 OF ■ , OtOOO 
IR CUBIC TFMM ALOKE ■ 0.017 



THE POEnrCTOR VARfAqLE/X) I5 0»Z, AND ThE CHI RION' V ap J iHLC { Y) ■ 1 5 TP ^CCMC, 
Trst MEANS ANO STANOaRO OEVIaTIONS 



1 X 




0.222 






? SOUAQ 




0.?*8 








0.7*0 








4 y 








rOflPELATlON 


MAT»IX 








X 


1 .000 


0.960 


0»8Q3 


0.908 


? SOtJAQ 




1 .000 


0.984 


0.^12 


1 X CIJ9C 


0.fl93 


0.9tt4 


\ iOOO 


O.A*J9 


4 Y 




o.su 




1 .000 



MHITIPLE R SOiiAOE ■ O.^^B 
►'ULTIPLE n • O^SOR 

N.o.r.i ■ T 
N.o.r,? ■ >7i 

F FOR AN*LVS!<; or VARlAfJCE ON R ■ 59*470 
BFT4 WEIGHTS 

o.nna 

CONTRlflUTlONS TO VUltJPLE COBRELATION 

AND »EG»ESSTON J^ACTCR LOaoINGSi 2N0 COlUHNI 
\ X n.zsa 1*000 

SOUiREO BET* WEIGHTS 

o,:»na 

B «FT<;hTS 
4.0BA 

InT^tRCEPT constant a 2i9d8 



HULTTPIE R SOUAPE " 0»2d6 
MULttPLE R • 0.5H 
N.O.r,! ■ 7 
N.0.r,2 ■ 170 

r *'0R ANALYSIS Of VARIANCE ON R ■ 30.763 
8ET* WCIOHTS 

fl.?09 0.312 
CONTPIBUTIONS TO ^'UlTIPLE CO'^RELAJION 

AND REORtS«;lON F4CTCR lOidInqSi 2N0 COLUMN) 

I X 0.106 0.9O) 

7 souar o.uo 0*993 

souareo beta weights 

0*044 O.OQT 

ft wrioHTs 

1.676 2.?7A 
iNTrRCEPT CONSTANT a 3t?5» 



MULTIPLE fl SO'UOE ■ 0*27i 
MULTIPL*: R ■ e*32i 
M.O,f*l ■ 3 

r ^OR ANALYSTS Of VARIANCE ON « ■ 20*966 
8ETA WEIGHTS 

?,199 -4.675 3.129 
CONTRIBUTIONS TO HUlUPLC C0R«ELAT10H 

aNO REORES^ION ^AcTCR LOaoI'^OSi 2N0 COlUHN) 

i X 1,117 0*9J5 

7 SOUAR •?.394 0«9d] 

-J » CUPr 1.5A9 0.9bO 

souared reta weights 

4.B37 2i.««9 9.788 
B WriOHTS 

17,664 -34. on? 20.481 
INTERCEPT CONSTANT • 3*22^ 



AN^VA TABLE ^OR POLYNOMIALS 



REnUCTlON Oljr TO Llt^CAR riT, WITH 1 Of a 0.?98 

Rr<;!r)iJAL s.s. ■ o<74^ or • 171 rEsioual m,s, ■ o.ooa 

r PflR LINEAR rlT ■ 59*470 



oFhucTiON our TO oeneral Quadratic riT with or 2t • . 0.266 

RfOilCTION M,<, a 0*133 

PESSOUAL S.«;, a n*73* of » 170 RESlOUAt M.S. ■ 0.004 

F Fntf^^OUAORATIC riT . 30.763 

REnilCTlON OliE TO CUApRiTrc TERM ALONEi WITH \ rf * ■ 0*008 
F FOR QliAORATfC TERM AlONE a lWa3 

PFOnCTtON OUIT TO OCnFRAL CUBIC fU WITH 3t i 0,27l 
RfOiiCflON M,5. ■ 0*090 
RESinUAL S.9. • 0*729 Of ■ 169 NEStOUAL M.S. • 0.^4 

r For OFNtRAl. CimlC fit • ?0.966 

nroiicTioN our to cu«*tC te«m alone iiith i of • , o.oo^ x 

F FnR CIJRIC TrPM iLOnE • ) .27* .(; 



, ET RATING 



TfST means A^^n STANOAfln oEVIaTIOnS 



t it 


n,«^7i 


0.210 










0.?25 








n,?5«) 


0.207 






4 y 




I .7B4 






CORQELATION 










1 < 


1.000 


0.Q77 






? SOUAq 




1 .000 




n .413 




0.'53? 


n.<3ti7 


li 000. 


n.iBo 


A y 


O.A4« 


0.413 


0.3Q0 


1 .nOO 



• w»9««s««».ioa«3i=»»»"30»aa»""B»"a"«""«8"»^ ■■■■■■■ 

MULTIPLE R SOMAPE ■ 0.l9fl 
MULTIPLE » ■ 0.445 
N . 0 , F . 1 ■ 1 
N.O.F.? ■ I?! 

r FnR AMALYST^ Of V<»BlANCE ON R ■ 42.260 
BFT4 WF10HT5 

n.445 

COWTRiniiTinNS TO MULTIPLE CORRKLAFION 

aNO oforf^^ION PacTCR LOadImOSi ?nO COLUMN) 
T V o.lgA 1.000 

SmJaPEO ACTA wflGHTS 

n wrtQHTS 

1,TQ9 

InTfRCEPT cOm^TANT ■ 4»344 

MULTIPLE fl SOiiAPE ■ 0.fA9 
MULTIPLE P ■ 0**ST 

N,o,r.i ■ ? 

N'. 0,^.2 n 170 

r FrtP ANJkLYST*; OF VAPlANCE On R ■ 22.*i6 
PFFi WFTfiHTS 

n,9n -ft, 4?^ 

coNTor"«nrflNS to vultjple correlation 

AND propE«;^ioN F"4rTCR lOaqIngsi ?nd column> 

1 X 0.406 0»9f4 

? SnUAR "0.194 0.904 

SOUflPEO BETA '-ETOHTS 
O.^IB 0.??9 

n wfTTihts 

7,769 -3.«'>2 ^ 
INTERCEPT CONSTANT ■ '^^.478 

MULTIPLE R S01>*RE ■ wS^l^ 
MULTIPtE R • Ot4<J* *^ 
N, O.F.I ■ 3 
N,0.F.2 ■ 164 

F FrtP ANALYST^ OF VARIANCE ON R ■ l4t942 
BET* WEIGHTS 

1 .2fl5 -I .1^9 0.^34 ^- - 

CONTRIRUTIONS TO ^-ULTIP-LE CORRELATION 

rNO oeoRES^ION Pac^CR LOioInGS* 2N0 COLUMN) 

J X 0,572 0.972 

? SOUAR *0.565 0*902 

^ » CUBF O.203 O.«30 

souareo reta weiohts 

1.6S1 0.?S3 
fl WEIGHTS 

10.937 -Ifl.ftTT 4.602 
INTERCEPT CONSTANT • 3*l<»3 



ANOVA TABLE FOR POLYNCmIaLS 



PFrkUCTlON our TO UnEAR FIT, WITH I OF ■ 0*19« 

PFSinuAL S.^, ■ 0.R02 or ■ l7l RESIDUAL M.J. a OiOOf 

F F^tP LINEAR FIT • 4?. 260 



RfnUCTTON ODE TO OEfuE&AL GUiORATIC FIT WITH OF 2* ■ 0*209 
RFOilCTlON M.S. ■ O.IO* 

Rf<;TOUAL S.S. a a. 791 OF • ITO RESIDUAL X,J« a 0*001 

F FftR OUAORATIC FIT m 22<4l6 

PEOilCTION OUF JCi CUAnRlTTC TERM ALCnE* WiTM I r.f • ■ OiOll 
F FOR iJUAORATTC TERM ALONE ■ 2i26l 



RfniiCTlON nUE TO OEnFRal CUBIC FIT WITH OF Ji ■ 0.210 

REDUCTION M,^, ■ 0,070 t 'trs 

Pf^lOUAL S.<* • 0. 790 OF • 1^9 RCSTDUal M.S. m dOOS 



ERIC 



- - FOR OFNERAL CURIC FIT • |4*942 

OIICTION f)riF TO CUWIC TE«H ALONE WITH I OF • , 0*001 
FOR CUMIC TrQH AL^NE a n.204 



pniYNOMfAu rrTTiNO KOH 2 vAHUiiLts-s«E AND IP icnHr, J54 neaenVATiOKS, 

FT RATING 



TFST MEANS ANn STANHiHC DEVfATIONS 



1 X 


^•103 


0.393 


7 SQUAR 




0.?5S 


1 « C«J«^E 


0.12A 




* Y 






CORREUATION 


MATPtX 




1 X 


Uooo 


0.9A4 


? sou«n 




1.000 


1 X CUBE 






A Y 


n,146 


0.322 



0*071 n«J46 
1 *000 il«90A 



MULTIPLE H SOMARE ■ 0»U9 
"ULTlPue p • n,34A 

^»n,f»\ ■ J 

F Foo analysis; nr vapiance on p • 2o»623 

SFT* WEfOHTS » 
0.346 

CONTHiflUTTONS TO •'ULTIPLE COPRELATION 

aWO «p(jflF«;«;rnN fac^Cfl L<3aoIn«S» 2NQ COlUA'NI 

1 X a. 119 1.000 

SOUaREO BtTA wFrO»*TS 

0«1|9 
»^ MrlOMTS 

?.AlO 

tNTFPCEPT CON<!TANT ■ 5.9n9 



WULTTPLC » SO«'*PE • O.UO 
KULTlPLr q • 0.3*6 

F FOP ANALYST^; OF VApI*KCE ON R ■ 10*259 
QFT* WEIOHTS 

0,3fl2 *0,O1« 
CONTPIRIITIO»JS TO MULTIPLE CQPftELAllON 

aNO OEORES«!10N FacTCP LOAOlNOSt 2h0 COlUHni 
I ^ 0»132 0.9'i»9 

P SnUAp -0.012 0.932 

SOU4(^EO BETA VFIOHTS 

0.146 O.ooi 
R WFIGHTS 

2.663 -0,3rtr 
r^'TFPCEPT CONSTANT • 5, 4^7 



MULTTPLC « SOUABE ■ 0*120 
HULTtPLf fi 9 0.346 
N.n.F.i ■ 3 
N,r>.F.2 • l5ft 

F FOP A*JALYST<; OF VARIANCE ON fl • 6.79S 
BfTA VffOMTS 

0.339 0.A43 -0.003 
CONTPlqUTlONS TO MULTIPLE CORflELATlOH 

AND Ql<itil<iKXOH FAcTCft tOA;OlN05f 2N0 CCHJPfH} 
\ X 0.U7 0.999 

? SOUAR 0,027 0»932 

1 % CUBE -0.024 O»650 

SOUa»EO pet* wEIflHTS 

0.U5 0»0ft7 0#607 
fl WfTlOMTS 

2.364 O.^^S •0,730 
INTERCEPT CONSTANT ■ 5*495 



ERIC 



ANOVA TARLE rOB POLYNOmTAIS 

REoucTTON nur to linear fit, with i of • O.U9 " "* 

RESIOIUL 5^.^. • o,BSi Of ■ 152 PCSfDUAl M,f, « 

F FOk UTNEAR rtl - 20.623 ; ^ 

PfnOCTFON our ro OEnEPAl QL|A0flATIC FIT uITH of 2t m 0.120 
ftEDiICTION M.S. ■ Oi0*0 

PE«>TnUAL - O.BAO: OF • 151 RCSlOUAL M,1, • o«fl06 

F FOR OlfAORATIC FIT . \Q,2*,9 

REOIICTION m»F TO CUAORATfC tEH*4 ALONEi WITH I rft ■ 0.000 
F FOR ODAORaTIC TERh aLONC 4 0.027 

flrnucTTON^uF to oenf«au Cuffrc fit witn of 31 • o.i^d 

RFOircTlON M.s, ■ 0.040j 
»E«;iOUAL • Q,ttsQ, DF • ]50 RCSfOUAU W,S, • O.00» J^-jl 

0_J0R OFNERAL CUttIC FIT • | 6.798 

llirTTON nilF TO CURtC TE«''i ALONE WfTM i OF • , O.OOO 
n» CURTC TrPM ALONE • j*010 



■ 399ai(r««Buuj1-i3ia«BB«B»?T'13«l«««'a^*«««'"1B^3aBBJBaB«liMji4««BBBBllB->«JBaaBBCI9B 

POLYNOMIAL FiniNO MM 2 vA» I At3ltS-HRt AKO TP SCO^^f.- OhSKbVA f IOnS . 



FT RATING 



TEST HF.AM^ 


awn sT*Nr>aRc 


DEy I »T lO^iS 
















7 50IJAR 


0.47A 


0.3&5 








0.410 


o.3Ar 






4 Y 


6,?4o 








CHROFLATION 










1 t 


) .000 


0.S76 


0.911 




? 50UAH 


0 .076 


I .000 


0,987 


0.396 




0 .Q3l 


0.987 


I. 000 


0.112 


4 Y 


n .p64 




0.312 


\ .000 



■ svBBVBasaaaasBSBBaaaaaaa^^Ba-jaSBBBBasssoasB 



Mi'LTtPLC SoniPE ■ O.O'O 
HULTIPLr « ■ 0.264 
N.n^f.i B f 

N.n.f.? B )5? 

f fnn AN«LV5I«? or vapUncE On b ■ nt394 
BF.lA WEIGHTS 
0,?64 

CONTHimiTIONS"' TO MULTIPLE COPREUATIOn 

• NO PFGnES«;iON FarTCR LOaoIn(5S» .2N0 coluhnj 
1 X 0.070 1.000 

SOUiREO B€TA wcrOHTS 

0.070 
n WFIGHTS 
1.372 

InTfRCEPT C0w<;T4HT b 5«460 



MULTIPLE R SOUAPE ■ O.loO 
MULT1P1.E fl ■ 0i3l7 
N. O.F.I B 2 
N.O.r.2 J 151 

F FOR ANALYST*; OF VAPUNC£ ON R ■ 8.408 
BfTA WETfjHTS 

-0.924 0.ft'k7 
COKTRIRUTIONS TO MULTIPLE COlRtLATION 

i^O PFGRrs^tON F^CTCP LOaoINOSi ?H0 COLUMN) 

? X •o.isa o.a34 

9 SOUAR 0.239 0.934 

SOUaREO BETA WEIGHTS 

0.275 0,^«;2 
8 wrlGHTS 

• 2.734 li.S^n ^ 
INTERCEPT C0N«;TANT b 5.6i5 



MULTIPLE R SOnARE ■ 'OilOA 
MULTIPLE R ■ 0.322 
M.O.f.l ■ 3 
*J,0,F,2 B 150 

F FaR ANALYSIS OF VARIANCE ON R ■ 5*784 
BFTi HEIGHTS 

0,3<»A -N?T5 1.303 
C0WTRIRUTrON5 TO MULTIPLE CORRELATION 

4N0 REQREfi^ION FAcTCR LOaqINQS* 2N0 COLUHKJ 
T X 0.)04 0.0^0 

? SOUAR -0.407 0«910 

X CURF 0.406 0«968 

SOUiREO BETA WflOhTS 

0.155 U^02 1,^97 
R WEIGHTS % 

2.048 -7.^Q9 7,657 
INTERCEPT CONSTAJ^T ■ 5*6o6 



AN^Va TARLC rOR POLvnqhIaLS \ 

RCnVJCTlOM OVJF TO LINEAR fit, \ OF ■ 0.O70 

RESinUAL S.S. B 0.930 OF ■ 152 RESIDUAL H,S* • tf*006 

F FOR LINEAR FIT b U.394 ^ 



RFftUCTlON our TO GENERAL QUADRATIC FIT iTlTH OF 2. b OilOO 
REnuCT ION M,^;, ■ OiOSO 

RE<;IOUAL S.^. 0.900 OF ■ 15J REStOUAL Xi5* ■ 0*00« 

F FOR OUAORATTC' FIT ■ 6*408 

JtEnuCtlON OUE TO CUAnRATir TERM ALCN£» W 1 TH I CF • ■ 0.030 
- F FOR OUAORATTC term ALOnE ■ 5.114 
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fiFOilCTlON OUF TO OEnFRAl CuBIC FIT WITH OF 3» b 0«104 

fiEOUCTlON M.S. a O.OJS I-12 

RfSlOUAL S.S, ■ fi.fl96 OF ■ 150 RESIDUAL J. • Ot004 

■ FOR GENERAL CUBIC FIT ■ 5,784 " ' 

IFOriCTlON OUF TO CUfitC TE^**< ALONE tilTH I OF • , 0,001 
' FOR Clinic TFRH ALO^jE b 0»S«2 * 



POLYNOMIAL flTTlNO F/lW J 2 V^H I At>lf. S-ORt AnO fP -iCOHe- 154 ChS£f»VA T IONS* 



/ 



FT HATING 



THE POCniCTrtft VAMI*nLC|>l\l5 ORE^.iiNO ThE CJH T^MIon V4PtARLE(Y) T1 TP s'cqffC. 



1 X 0.932 \ 0.07l 

? SOilAR 0,n73 AO. 125 

a X cunir \Oii7o 

4 Y 6.?*0 ?iO*2 

COR^f.LATTON M4TPIX \ 

1 X I.OOO 01.997 

2 SOUAR 0.i997 1.^0 0'-, 

3 X CURE 0.991 0,9^B'* 

4 Y 0.374 OiJd^ 



0,991 
0.998 

UflOO 
0.36? 



0.374 
0i380 

l«O00 



r^«;T, SECONO. AND THIRD heOREt PULYNOMIALS, 



MULTIPLE « 50MAPE a O.MO 
MULTlPLr R » 0«3T4 

N,n,r.i ■ 1 

N.0,r,2 m 152 

r ron analysts or variance dn R ■ 24i72i 

BfTTa WEIQHTS 
0.374 

CONTRIBUTIONS TO MULTIPLE CORRELATION 

AND RCQRES^TON FftcTCR LOADINGS* 2N0 COLUMK) 
I X 0.140 1.000 

souaped RETA wEIQHT) 
0.140 

R WrlfiHTS 

iNlFflCEPT C0N«;TANT ■ -3iS40 



MULTIPLE R SOirARE ■ O.US 
MULTIPLE R ■ 0.3fl^ 
N.D.r.l • t 
N.b.r.2 " I9l 

r rnR analysts or vapIancE on r • I3«l96 

BETA WEIGHTS 

-0.926 I.IM 
CONTRlfiUTI0*)$ TO VULTfPLE CORRELATION 

AND REORE^^ION ficTCR LOaoINOSi 2ND COLUMN) 

[ K •Q,346 0.9/1 

^ SOVJAll 0.495 0.965 

SOUAREO BETA wciqhTS 

O.058 
A wrIOHTS 
-?A.793 2i.?l1 
INTrRCEPT CONSTANT • |2t68l 



MULTIPLE R SOiiAPC • 0*U5 
MULTIPLE R ■ 0,40« 

N.o.r.i • 3 
N.o.r.2 ■ ISO 

f rnfl ANALYST^ or variance on R ■ 9*S7l 

BETA WEIGHTS 

-?4,«07 52.«l8 -27. 7*6 

CONTRIBUTIONS TO MULTIPLE CORRELATION 

aNO REQRES^ilON FACTCR lOadINQSi 2N0 COLUMNl 

J X -9,278 0.921 

? SOUAR 20,090 0.939 

1 X CURE -10.607 0,942 

souaped beta weights 

6lt5,370?7«9.744 769.824 
B WrIGMTS 

717.524 899.^98-334, 275 
iNTfRCEPT CONSTANt ■ 199, U4 




ANOVA TABLE fOR POLvNONIALS 



opnucTTON nil*- TO LINEAR riT, yiTH 1 or • o.uo 

RE'iinUAL S^S. ■ 0.860 Of ■ 152 RESfOUAL M,S« 

f rrsq LINEAR riT ■ H4.7>1 



0*006 
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REDUCTION our To OElvEPAL QUADRATIC riT wiTH or 2t ■ 0.146 
RFOHCTION H,S. • 0.07^ 
PF^IOUAL S.f(. ■ 0.fi52 or • 151 RESIDUAL M,i, ■ o*006 

r rnp ouAORATtc riT ■ |3,H6 

REDUCTION our TO CUAnRATiC TERM ALONEt WITH 1 ■ • O.OO* n 

r rrtP QUADRATIC TERM ALONE ■ 1.508 

• • — — — - — — \ 

Rr.OllCTlON our to 0E*4E«*L cubic riT WITH or 3t ■ o.u% 

REDACTION M,$* ■ o.oM T-T^ 

NE<;tQUAL S.4. ■ 0*839 or ■ 190 RESIDUAL M,S, « . o*006 ^ * 

roR GENERAL CURIC fll ■ «.B7l 

nucTiON our to curk tern alone ^ith i or • , otOiA j 

rnP CUBIC T^Rm ALOwE ■ ?.959 



Pni.YN0M[4L f^rlUiQ fr\U 2 VAHUMUtS-NHt />nO T^* scone- is* OflSCflVlTtONS* 



FT RATING 

The PRE0!CT0« ' A«1APLEU> is WRe» *N0 TMt CCUTeHION VAfl)ABLtU» '15 TP ^COH£< 



TEST ANn STANOaRC 


OEVtATIONS 






1 t 0,a20 


0.190 






? SQUlf) O.AZO 


0.21^ 






5 X CURE 0,100 


o*aM 














corpelation matrix 








I X ' 1.600 


0.970 


0.9U 
0.9gA 


0.430 


? SOUAP 0.Q70 


1.000 


o.3a« 


3 X CU9E 0<Ql9 


0.9B6 


1 .000 


0.144 


4 . 1 0.*30 


0. JdB 


a«34A 


1 .^^00 



MIJLTlPLF SOMIRE ■ 0tl*^5 
MULTIPLE « ■ 0.430 
•^lO.Ftl • i 

F FnR ANALYSTS OF VARlANCC ON R • 34.332 

reta weights 

0,430 

CONlOJIflUTlONS TO MULTIPLE CORPELATION 

aNO REOOf^srON Fac'TCR LOaqINOS* 2ND COLUMN) 

\ X o.ies I. 000 

souarco rcta weights 

0,185 
B WEIGHTS 
4,639 

[•yTFRCEPT CONSTANT • 3!36ft 



MULTIPLE fl SOtlARE ■. 0.i?nO 
MULTIPLE P ■ 0»44fl 
N.O.F.l m 2 
N,0.F,2 • 191 

F FOR ANAL'VSTS OF VARIANCE ON fl • 18.907 
BETi WEIGHTS 
0.*>23 -6,^n*» 
. CONTRlflUTIOWS TO MULTIPLE CORRELATION 

iNO REGRE«i<;rON F4CTCR LOAOlNGSt ^NO COLUMN) 
\ t 0,397 0.^<>l 

^ SOllAR -n.!?? Oifl66 

SQUARED RETA '^EIGMT!; 

0,a52 «.?<^<l 
R WFlfiHTS 

9,943 -4.«'}? 
INTERCEPT CONSTANT • 2»l0* 



MULTIPLE R SnilARE • Ot'^fi^ 
MULTIPLE « • 0.*5l 
N.O.F.l ■ 1 
N.OjF.a • ' |90 

F 'for analysis; of variance oh ^ ' 12.7R6 
BETA J*ETGHTS 7 . 

0^324 0.904 •0.92i 
contributions to I'ULT/pLE CORR^tfflON 

iNO PEORESSION FAjfTCR lOaiMNGSi 2N0 COLUHNV 
1 X 0,141 0.953 

9 SQUAR 0,3^2 0*659 

y t CUBE -•C*319 0t762 
SOUiREO BETA wFIQNTS . 

0,107 0.9^9 0,B61 ^ 
n WEIGHTS 

3,931 9.1*9 •9.994 
INTeACEPT CONSTANT m Z*^\l 



ANOVA TABLE FOR POLYNOMIALS 



REnUCTlori OIIF TO LINEAR F[T, WITH I Of ■ 0.)«5 

PFSlDUAL S.S, m CB^S OF • 192 REStOUAL M«S> • 0«OO9 

F FOR LINEAR rfT ■ 34,532 



OfnUCTlON nur to general OuaORATIC'FIT witH OF 2t • 0.200 
REOdCTlO^ M.S. • O.lOO , 

RE<;inUAL S.s, • o,ftOO 6f • 151 RESIDUAL M,9, • 0«005 

F For OIIAORATIC FIT ■ 18»Q07 

REniiCTiON nijF TO cuAnRATir term alone» with ro^» ■ 0.019 

F FOR OUaDRATtC TEPm ALONE ■ 2,860 

REnilCT:.ON nuE to OCnEPAl Cll«IC F^T WITH OF 3t . 0,204 

REnnCTlcJN M,S, • 0.068 t i ii 

PESIOUal S.S, • . 0.796 OF • 190 RESIDUAL H,s« • 0.009 I" I** 

^ rFoR OFNERAL CWR|C FIT * 12.7B6 

iOMCTlON ni)F TO CUBIC TF^M ALONE WITH 1 OF • OiOOS 
FOR CUBIC TFRM ALONE • 0.639 



IC RATING 

fNf PMEiUCTOP VAfiI»hLC<R» 15 S«C» ANO THC CRtTfRlON* VARUBUiV) tS itiOWC* 
ffST MfANS AN/> 5TiNr>ft«C nCVUTJONS 



) « 


0.?66 


0«280 






? SOIJAA 


0.1 «e 


















4 V 




?.3n 






CA0«rC4T ION 










1 I 


I.AOO 




0.044 




? SQUAA 




1 .000 


0.9T1 


0.345 




0 1^46 


1.000 


Of309 


* Y 




0i3*S 


n.3o9 


V.OOO 



rtfl'iT, 5€CO»4n. ano TmIPO nfOPEt pvjLynOM|au3, 



N.n,r,| ■ ? 

r rAQ ANALvst5 or vAotiiNcC ok R • 6.4oT 

CnNTR|«ur|ON$ TO »'UuT|PLC COP«CLATIOn 

»V0 PEOftCS^tON FACKP LOaoInOSi 2N0 COLUMN) 

1* X o.ni 1.000 

SQUaPCO PCT* weiOHTS 

o.ni 
ft wrtOHis 

iNTrocEPT ^ON^TANT ■ 4.738 



MULTiPi.c p soHAPc ■ a«Ui 

•".iLTIPtr B • rt,3A? 

N.o.r.i ■ ? 

r r/iP ANALYSIS or VAPtANCC On R ■ 4*136 
B»^TA jtCIOhTS 

O.fTO 0.n44 
CONTO|mjTtO*<S TO •'ULTIPLE CORRCLATION 

AND oeOOeS^tON r^cTCR L»JAOINOS» ZNO COLUMN) 
J X O.IU 0.999 

7 soUAq 0.0t9 Oo9S« 

SOUiOeo ACTA "^riGHTS 
r>«lO? O.Oti? 

a rffiOHTi ^ 

7.TII 0.AT4 
I>iTrPCEPT CONSTANT ■ 4.761 



MULTtPLr. a SO^IARE " 0.1)3 
MuUTfPLr ff ■ 0.36A 

M.o«r.? ■ 54 

r roP ANALYSIS or VARIANCE ON R ■ 2*755 
•ClA wCIOHTS 

0.063 -0.*?} 
CONTPIAUTIONS TO N'UtTIPLC CORRELATION 

4N0 PEORES^TQN fAcTCR LOaoINOSi 2NQ C01.UNH) 
I t 0»0?3 0.992 

? 50UAR o.2*i 0.947 

J I CURf -O.Ul 0.847 

500«R€0 nCTA WCTOHTS 

O«0O4 0.*«7 0,t79 
8 wrlOHT5 

0.S34 7.^A0 •5.306 
iNTfPcEPT CONSTANT ■ 4.ai4 



*N<>V* TAHLE rOR POUYNCMIALS 



oEAUCTtOH Otir TO LINEAR r|T. wiTH I Of ■ 0.131 

PESIOUAL ^.^^ ■ 0.869 Of ■ 56 RESIDUAL M.S. ■ 0«0l6 

r r.oQ LINEAR rIT ■ ^.407 



PEnuCTION Oti*^ TO QEnEPAL QUADRATIC F^T WITH Of 29 ■ 0.131 

prnucTfoN • 0.O6S 

ur^inUAL S.^« m r.869 DF ■ 55 RESIOUAL ^iS* • 0.016 

F ftsa OiMORATTC FIT • 4.1:^6 

PEHMCTTON liUW TO OUAORATIr Jwi\H aUONEi WITH I C^i ■ O.OOQ 

F FnR OUApRATtC TEPm AtONE ■ 0.014 



RFOhCTiOh our TO OE»^rRiL CUSIC FIT wiTh OF 31 . o.lSI 
RFOHCTION M.S. ■ 0.044 
PrmOUAL S.^« a 0.^6? OF • 54 REStOUAW *<»S. R^ OtOt6 1*15 

l-pjY^rfttt OfNERAv CUfltC FIT • 2.755 

tKlv>r>nrTto^< our to Cu«|C TERX aLONE *ITH I OF • , 0»00> 
Liaia i J i fermi i j roP Cli»tC TrPM »LO^.E • 0.125 



50 OrtSEftVATtONSt 



IC RATING 



TMC PQEOICTOR VAniAflLCU)" li PfiEi AND THE C«tTjrtJON VAn'^flUtiy) !s'tp SCOftE, 



TFST means Afin STANH^flC OEVUTIONS 

I t 0,<^08 0.394 

? SQUAR 0.4M 0*3^9 

1 X CUfJP 0,350 0,3*1 

♦ Y 5,552 2,371 

CORRELATION MATRIX 

I X I .000 0t976 

? SQUAR 0,l7t^ 1,000 

3 X CURE 0.^^36 0*969 

4 Y 0.322 0*350 



0«9)(| 
0*989 
I •000 
0.362 



0*322 
0.3S0 
0«362 

Nnoo 



FIRST, SECONO, ANO TMlfiu nEOR^E POLYNOMlAtS, 



MULTIPLE SOi»AR€ • 
HIJLTIPLC n • 0*322 
W,0,F,1 ■ \ 
N,O.F,? ■ 5* 

F FAQ ANALYSIS OF VARIANCE ON R ■ 6,493 

r Ta weights 

0^^322 

CO 4TBI«UTI0NS TO MULTIPLE CORRELATION 

4^0 REr,RES^TON FAcTCR LOAQlNOSf 2N0 COLU*<N> 
1 X 0,104 1,000 

SOUAREO RETA wEtOHTS 

O,l04 
R WFtOHTS 
1,914 

Intercept constant • 4*590 



MltLTtPLC n SOIIARE • 0*1^1 
HOLTIPLC R • 6,36? 
N.D.F*! • ? 
N.O.F.? a 55 

F FOR ANALYSIS OF VARIANCE ON R ■ 4*142 
BETA WEIGHTS 

-0,4J7 6,7S7 
CONTRIBUTIONS TO I'ULTIPLE CORRELATION 

AS'O REORCSSTON FACTCR LOaoInGS* 2ND COLUHni 
f X -0.134 0*891 

^ 7 S0U4R 0.265 0*968 

SOUAOEO BETA Wfr|OHTS 

0.)i74 6.ST3 
R WFIOMTS 

-2.475 4.012 
iNTirRcEPT CONSTANT ■ 4,773 



MULTIPLE R SOIIARE * 0*^34 
MULTIPLE 1^ • 0*367 
N«0,F,l a 3 
N.0.F,2 • 54 

F FOR ANALYSIS OF VAPlANCC ON « ■ 2*796 
.ertA WEIGHTS 

0.378 U?44 
CONTRIBUTIONS TO MULTIPLE CORRELATION 

AND REOPESSION FAcTCR LOaqINOS* 2ND COLUMN} 
1 X 0.122 0*079 

7 SOUAR -0.^38 0.955 

3 X cue? 0.45i 0*967 

SOUAREO BETA WtlOHTS 

0.143 1.565 1.952 
P WEIGHTS 

2.245 -B,TT6 0.«6« V, 
INTrRCEPT CONSTANT ■ 4*739 



ANOVA TA^L^ FOR POLYNOMIALS 



oroncTfON Oi;r to LTNCAR fit. iflTH 1 0^ • 0*104 

RESIDUAL S,S, • 0,896 OF • 56 REstOUaL M,j, • 0*016 

F FOR LINEAR rtT ■ «,49:» 
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RmucTlON Oflf TO OENERAL GUaORATIC FIT KJTH OF 2t • 0.131 
REOUCTION M,s» • 0,O63 

RESTOUAL S.S, • 0,A697 OF ■ 55 RESIDUAL M.s* « 0*016 

F FftR OUAORATIC FIT • 4*142 

Ri:OMCTION OlIF TO OUAORATIr TflPH ALONE. WITH 1 0^* • 0*027 
F FqR OUAORiTTC TERM AUOnE • 1.709 

RFOilCTTON OIIF TO OCnITRAl CUBK FIT WITH 0^ 3* ■ 0,134 
REOUCTION M.S. • 0*045 
REStOUAL S.S. • 0*A66 OF % 54 Rt'S|OUAL M.s. • 0*016 

FnR GFNCRAi. CUR|C PIT • 2.796 
lEOuCTION nUF TO CURlC T£«H ALONE HITH I OF • , 
FOR CURIC TFRM ALONE a 0*222 



0«004 



M6 



\ 



POI VMIMMI. KlTTtKO POH <» V AH ] AMI t S-0«e AnO TP SCOMg* 5fl - HSK" V A T | OkS « 



Tnr PUfOICTOH VARrAnj,C(X) IS OREi AND THE CRlfHlON "/A": UHLE tf) - IS TP 3CCJ»E 





A^^^^ 5TANnA«n 


0EVUTI0N5 






) X 




0.161 






? SQUAP 




0.?1A 






< CUBE 


0.751 








* Y 




2.3M 






Cr^RoeLATiON 










1 X 


1.600 


0»99A 


0.901 


0.317 


? SQUAR 




1 • 000 








o.ool 


0.989 


uooo 


0.301 


A V 








ItOOO 



MULTIPLE B «ionARE • 0.i*9 
MULTIPLE n ■ 0.3^7 

r Too ANALYSIS OF VABlANCE ON R • 9.83S 
r*fT* WFIGHTS 

CONTni«UTI0>^S TO VULTIPLE CORRELATION 

aNO PEOR^S«;ION f AcTCR LOioI^'GS. 2N0 C0L0MN1 
T X 0.149 L.OOO 

SOUinEO BCTa wriOHTS 
0.149 

B WrlOHTS 

INTERCEPT CONSTANT ■ 0»4<>A 



MLiLTlPLE R SQilAQE ■ O.l^A 
MULTIPLE R • fl09p 
N. O.F.I ■ ? 
N.CI.r.2 ■ 59 

F f(^P ANALYSIS OF VARtANCC On R ■ 4.995 
eET§ MEtOHlS 

0,178 0.?19 
CONTRIHiiTIONS TO ►'ULTIPLE CORRELATION 

A^O »'E0RF«5SI0n F*cTCR LOAOlNGSt 2N0 C0LUHK| 

T X O.0i^9 0.9«6 

? SOUAfl 0.085 0.991 

SOUAflEO HETA wpfiOHTS 

0.032 0.04S 
fl WFIOHTS 

2.419 

INTERCEPT CONSTANT > 1.263 



MULTIPLE R fOiiARE ■ 0.U9 
MULTIPLE " ■ 0.4ii 
^.').F.l ■ 3 
N.0.F.2 • 54 

F Ff)R ANALYSIS OF VARIANCE ON R • 3*668 
SETA WEIGHTS 

I. en -4.77? 3.467 
CONTRIflUTn^JS TO MULTIPLE CORRELATION 

ANO OCQRESSION Fif'TcR LOADINGS. 2N0 C6LUHN| 
\ ^ 0.701 0.Q39 

? 50UAR -1.853 '^.9*4 

3 X CURE l.3^^ 0,927 

SOUaREO beta WEIGHTS 

3.?B7 ?2.7A7 12.023 
B WEIGHTS 

76.763 •52,7A8 31.519 
INTERCEPT CONSTANT • Q*^53 



ANOVA TA«LF '"CP PCl.YNCHlALS 



REniJCTfON DUP TO LINEAR FjT. WITH \ Of • 0*149 

or<;roUAL S.S. ■ 0.851 OF • 56 flEStOUAL M.S. n 0»0l9 

F F0*» LINEAR PIT ■ 9,A3«J 



PFrHirTlON niJf To GENERAL OUAOflATlC FIT ilTM OP 2* « 0.1S4 
RFOUCTION M.^. B 0.n77 

RF«;TnitaL S,S. ■ 0.RA6 OF • 55 RESjOUAL M.S. • 0*elS 

r For OMAORATrC FIT B 4!9q5 

RrnucTioN nuF to cuAnRATir terh alonei ^^ith i • 0»004 

F For OUAORATrC TERM alOnE ■ O.ZflO 



REDUCTION nUF TO OE^ePal COBIC FIT wlfM OF ?• • 0.169 
RFOiiCTlON M,S, • 0.056 
^"•"SIOiJftL 5,S, ■ n.fl3l OF ■ 54 RESIOUAL H.J* m 0«0l9 



OR OFnEwai. ClifllC riT ■ 3.66fl 

lICTION nuF Tn CUrtiC TER*' ALONE NMH I OF • , 0,016 
OR CiifUC Tr»M ILO^F ■ 1.01? 



IC RATING 

TFSt MEAWS ANH STANOARC DEVIATIONS 
i < 0,S42 0,190 

? souAR o.iag 0.20? 

^ « CUflC o,?l6 0.109 

CORPELATION MATRIX 
1 * I. 000 0.982 0.942 n-4l4 

I ^rnar "'"^^ ^''fl' 0^5 

■ J T I'lxi ''T, S: o 

0.434 0.392 0.341 l.nOO 

:E\"E:L"i^^ 

MULTtPLE R ■ 0,434 
O.F.I ■ f 

r FOR ANALYSIS OF VahUNCE ON R ■ 12.997 
BETi WEIOHTS »c.^iff 
0,434 

CONTRIRUTION?; TO MULTIPLE CORRELATION 

ANO PEORF?-;rON FicrCR LOAOlNGSt ?N0 COLUHNl 

! V O^ltS 1,000 

SOUarEO beta WEIQHT5 

o.ifte 

B WflOHTS 
5.4?6 

iNTrPCEPT CON<?TANT • 2,fttl 

MUcTlPLK R SOJIARE ■ 0.2*l' 

MULTIPLE R • 0.491 
N,O.F«l • ? 
N,0,F,? ■ 95 

F FOP ANAtVSh OF VARIANCC ON R ■ 6.746 
BETi WEIGHTS "•'4D 

t,6I6 -1.2-14 
CONTRIRUTIONS TO MULTIPLE CORRELATION 

4N0 OEORESCION FACTCR LOaqINOSi 2N0 COLUMN) 
I * 0.701 O.flttA 

> S0U4R -O.iCt 0.77i 

SOUaREO flETA >*EJOMTS 

2.610 U4A9 
ft WrtGHTS 

?0.199 -13, M9 
INTERCEPT CONSTANT • -0.852 

MULTIPLE R ■ 0.541 
*'.C,F,| • 3 
N,0,F,2 m 94 

F FOR ANALYSIS OF VARIANCE ON R • 7,441 
BETA WEtOHTS * 

5,4A0 •9,<>3A S»016 

CONTRIBUTIONS TO MULTIPLE CORAELaTJON 

ANO REGRESSION F*cTCR LOaoINOS* 2IV0 COLUMN) 
! » 2.370 0.603 

? SOUAP -3,796 0W06 

1 M cUflF i,7l« 0,633 

SQUARED BETA WFTQHTS 

29.915 9fl,ffl7 25.T5a 
B WEIOHTS 

6R. 262-113. 94H 63,fl29 
INTERCEPT CONSTANT » -7.572 



anqva table for polyncmIaLs 

PEnucTiON o\fr TO linEar Fit, with I of • "'"hss*"* 

RESIDUAL S,S, • 0.«12 OF a 96 RCSTOUAL * ■ a 

F FOR LtNEA<J riT • 12,997 hcjiuval '••I, - o.oU 

REnUCTlON our To OPnEBA-L QUaORATIC fit with of 2, • 0.P4I 
REOliCTION M.S. • 0.121 • n ur c, • o.Z»l 

F FOR OUAORATtC FIT . ?.746 RtSlOUAL M.J, . q.^U 

REOi:CTION OUF TO OUAORATIc'teHM ALONE, WITH 1 ftF, • fl.o«-» 
F FOR Qi;AORArtC TERM alOnE • 3.636 * • ^.092 

REOilCTION OllE TO OEneRAl CUBIC flT WITH OF 3, m A aa) 

REOIICTTON M,S, • 0.0^7 ' 

REsrOUAL S.S, . o.7Pa OF . 94 RESfOUAL M,9. t o.OtI 

r FnR 0FNEP4I cuflic FIT • 7,A4l ' I-IO 

T-rti^i^l^** '^"^ ^^'^^^ TE«M ^tONE WITH J OF ■ , o.OH! 
ERIC .^'J"'^ TPPM ALONE • 3,9o« • 



POLYNOMIAL rXJU^Q FOR ? VAR t AdLES-S^iE anO tP SC0M<* |39 OBiEPVA F rONS, 



RD RATING 

The PRCOlCTOn VlRI*4flLC(X) IS 5RE. AND ThC CRITC«I0N VlpfABLtfY^ IS TP ICORC, 
TrSf HHANS ANO ITAhOAHO OEVUTIOWS 



t X 


0,14? 


0«356 


? SOUAR 


0«?4S 










4 Y 




1*504 


CfiRpELATfOK 


M4TRIJI 




1 X 


1 tOOO 


0.^77 


7 SQUAR 


0.977 


1.000 


X CUBE 






4 Y 




-0«U0 



0.930 •0.lft8 
0.96^ -Clio 



FTRST, SITCONOi ANO THIPO oEOnEE P^LYNOWIALS, 



MUi.TTPLC n SoiiAflE • 0*029 
MULTIPLE R • (iA6f^ 
NtO.F.l ■ I 
N,n,F.2 > 13T 

F FOP ANALYSTS or VAPllNCE ON R • 3.979 

err* weights 

CONTPIRUTTONS TO ^'ULTIPlE CORRELATION 

iNO OfOPeSSION F4CTCR t040lNO$f 2N0 COLUNNf 
1 V 0,02s -1«000 

SouiREO BtT* wrtOHTS 

0.078 
B WFIOHTS 
-0W31 

IMTjfPCEPT C0N5TANT • 3i0ST 



MULTIPLE R SOMARE • 0*0^3 
MULTIPLE R • 0.309 
N*0,r.1 ■ ? 

F FOR ANALYSIS OF VARIANCE ON R ■ 6«96l 

erri vEr^HTs 

-1,324 !,Tq9 
CONTRfrtUTfOMS TO MULTIPLE CORRELATION 

4N0 QEORE^^ifON F4CTCR LOAOlNOSt 2N0 COLUHni 
\ t , 0,223 -O.SSl 

P 50UAR -0,130 -0.36C 

SOUAREO BETA WEIGHTS 

1,758 i*4A9 
fl WEinHTS 

-«^,788 6.M9 
iHT^rPcEPr COM^TaNT ■ 3»182 



NUCTlPLe R SQUARE ■ 0*l3t 
«OLTfPLF R • 0.362 
N,0,F,l ■ 3 
N.0,F.2 ■ 139 

F FQR ANALYSH OP VARIANCE ON R ■ 6*801 

BETA WEIAHTS 

. 1«0«9 -^.A^ft 3.332 

CONTRIBUTIONS TO ^'ULTJPlE CORRELATION 

ANO REGRESSION FAfiTCR LOAQlNOSt JNO COLUMnj 

1 X -0.179 -0.*?4 

;» SOUAR A. 49ft -0.302 

^ » CUBE -0,176 -O.!** 

SOUAREO BCTI WEIGHTS 

1.133 19, $77 Il,i02 
8 WFlOMTS 

4,647 -24.^44 22.430 
INTERCEPT CONSTANT ■ 3<I38 



ANOVA TAfltE FOR POLYNCMIA'^S 



PEr>UCTlON pof TO LInEaq FfT, WITH I OF ■ 0.028 

OE^tnUAL $,S» • 0,972 OF • ,37 flESlOUAL H,S. • O.OOT 

F F'^R LINEAR FtT m 3,^79 



DEnUCTTON OUF TO OF^iEPAL OUAORATIC FIT WITH OF 2% m 0.093 
REOIICTION M.S. ■ 0,04« 

PfSlOUAL S,S. • 0,907 OF • 136 REjfDUAL H,s. • O.OOT 

F FOR OUAOBATlC FIT • ft.Qftl 

REnuCTrON OUF TO CUAOWl T IC* TERM ALOnEi WITH I r^* • 0.O6S 
F FOP OUA0R4TIC TERM AlOnE ■ Q.«90 



ERIC 



REOilCVION DUE TO OENERAt. CUBIC FIT WITH OF 3« ■ O.lJI 
REnuCTTON M.S, ■ n.04* 

^ESlOU4Lv-#;-S, • 0,869 OF • 139 RCStOUaL m.s. > O,o06 

- » General cubic fit • 6,B0l 



TION OUF TO CUmC TeRH alone ^ITH 1 of • , 0,03R 
I CUBIC TrflM ALONE - 9.972 



POLYNOMIAL riTTIMO J»nft 2 V AH ] AbLES-Pflt ANO TP SCORE, 139 ntJ^EOVA T I0w3 . 



1 X 


0,479 


0.473 


? SOUAR 


0.447 


0.456 


1 X CUBE 


0.A29 


0.444 


* y 




1 »564 


CnRBELATtON 


MATRIX 




1 X 


1 .noo 


0.994 


? SOUAR 


0.O94 


1*000 


1 X CU8C 




a. 997 


A Y 


-0.31? 


-0.213 



RD RATING 

THE PREniCTOR VARtAfllEfXl IS PflE , IND THE CRiTEfllON VAP.I4«LE|Y) 15 Iff ScORK, 
TKSt MEANS AKn STANniHn OEVIaTIONS 



O.'Jfl? •0.?19 
0.'?97 •O.?!! 

NOoo •n.eofl 



rtR^Ti 5EC0Nr», AMO TMiPo SrRflEF P^^LYNOMjalS. 

MULTIPLE R SOiiARE • 0.04A 
MULTIPLE R n n.2|^ 
N.O.r.l ■ j 
N,0,r,2 ■ 137 

r FOR ANALYSIS OF VARIANCE ON R • 6.612 
HFTi WEIGHT? 
-0.21S 

CONfRIAUTlDNS TO ►'ULTIPLE CORRELAftON 

iNO OEORES^rON FirTCP lO»OINGSi 2N0 COLUHNJ 
? X 0,046 -1.000 

SnUlREO RETA WEIGHTS 

0,046 
R WFTOHTS 
- -0.710 

iNTfRCEPT CONSTANT ■ 3?U3 

MUirtPLE R SQUARE • 0.0^6 
MOLTIOLE » • 0.219 

N,iD,r,i ■ 7 
N.0.F,2 ■ i3ft 

r FOR ANALYSTS OF VARIANCE ON R • 3.282 
BETA WEirtHTS 

<-0,2fl4 -0#(>10 
CONTRlRUTrONS TO ►'ULTIPLE CORRELATION 

AND REflRESslON r*cTCR LOadINGSi 2ND COLUHN) 
T X 0,044 -1 .000 

? S^OAR 0,002 -0.994 

SOUiREO BETA "EIGHTS 

0,042 0,flOO 
R WriOHTS 

•0.676 •O.rtt* 
INTERCEPT CONSTANT ■ 3.UJ 

HIH.T1PLC « SOriARE ■ 0.0^3 
MUttTPLf R ■ 0.304 
N.O,r.l ■ 3 
N.0,r.2 • 139 

f rOR ANALYSIS or VARIANCE ON 0 • 4.S92 
BETi WEIOHTS 

10,549 -2S,9o1 15,252 
CONTRIRUTIONS TO HULYIPLE CORRELATION 

AND RCORESSTON FAcTCR LOiQlNOSi 2N0 COLUMN) 

1 X -2,263 -0.705 

? SOUAR 9.527 -0.701 

? X CUBE -3,171 -0.6M3 

souabeo beta weights 

1U,?R3 670.o<(l 232. Aas 
R ^EIGHTS 

34,915 •BA,fti(A 53.73d 
INT^RCCPT CONSTANT • 3.132 



ANoVA TABLE FOR POLYNOMIALS 



PmuCTlON fJiJF TO LINEAR riT» WITH 1 D^ ■ 0.Q46 

REStOUAL S.S, - 0.954 DF - I37 RESlOUAL M.j^ . o.rOT 

F FOR LINEAR FIT ■ 6.612 



ERIC 



OEnUCTTON DUF TO OEkEBAL QUADRATIC FIT WITH DF 2i ■ 0.046 
REDUCTION M,s, • 0.023 

OESI0U4L S.S. . 0.954 OF - 136 RESIDUAL H.j* • o.ftGT 

F FnR OUAORATTC FIT . 3.?fl2 ^* 
REDUCTION OUF TO CUAORATIC TEHh ALCnE* WITH 1 nf • ■ 0.000 

F For ouaopattc tern alonE ■ o.ooo 

RFOllCTION l,.JE to general CUBIC FIT WITH OF 3i . 0.^93 
REDUCTION M,S, ■ 0,o31 
RESIDUAL S.S, • 0.907 OF • I3S RESIDUAL M.S. • 0.007 1-20 

^ FnR flFNCRAL CUBIC FIT • 4.592 

ntlCTION OUF TO CURIC T€«H ALONE WITH 1 DF • , 0.047 
roR CUBIC TfPM alone • 6,9?6 



RO RATING 

TkF PREDICTOR VARI*RlE(X» IS ORE • *N0 IHE CRITERION VARUflLCtY^ JS TP SCORE. 



TEST MEAN5 *Nn STaNDaRC OCvIaTIONS 



1 t 


0,069 


O«0S4 


Z SOtMP 




0iO9t 


1 X cimE 


0,919 


0.U9 


♦ Y 




1.564 


CnPRELATtON 


MATRI)( 




1 X 


I .ftOO 


0.992 


? SOUAR 


0,092 


IfOOO 


3 X CUQE 


0.97? 


0.994 


4 ¥ 


0.621 


0*006 



0.972 0fO2l 

0.994 0.006 

1.000 «0.O99 

>0f009 l.AOO 



rTR5T| SECONOt ANC TwlBQ r^COREE POLYNOMIALS. 



MULTTPLE R SOtURE • 0*0;o 
MULTIPLE R • 0,0;>l 
N.O.F.i • I 
N.O.r.? • ]3T 

f FnR ANALYSTS OF VARlANCC 0K> R • O^OAO 
8FT« WEIGHTS 
0,021 

CONTRIBUTIONS TO ^'ULTlPLC CORRELATION 

4NO RE0RE5^T0N F«cTCR I.OaoINOSi 2N0 COLU>*N) 
1 t 0.000 1.000 

SOUitREO BETA WEIOHT5 

o.ooo 

B urlOHTS 

INTERCEPT CONSTANT « 2.222 



NUITIPLE R SQUARE ■ 0.013 
MULTIPLE R • 0«ll3 
N.O.F.i ■ 2 
N.0.^.2 • 136 

F FOR ANALYSIS OF VARlANCC ON R • 0.873 
9rTi WEIGHTS 

0.871 -6.*S7 
CONTRlRUTlOfJS TO MULTIPLE CORRELATION ' 

AND REGRESSION FacTCR LOAOINOSi 2N0 COLUMN| 
] t 0,010 O.lttS 

7 SQU4R -0.006 0.057 

SOUaREO beta ""EIGHTS 

0,7«I9 O.T-^S 
B WEIGHTS 

P3.J4S •14,fll0 
INTERCEPT CONSTANT ■ -7.6o2 



MULTIPLE R SOMARE • 0.047 
MULTIPLE R • 0.2lf 
N.O.F.I ■ 3 
N.O.r.2 • 13? 

F FOR ANALYSIS OF VApIlNCC ON R • 2i2l6 
BETA WEIGHTS 

39.917 -SSfSrA 46.272 
CONTRIMUTIONS TO MULTIPLE CORReL*tlON 

AND REGRESSION FAcTCR LOaoINGSi 2N0 COLUI<K» 

i X 0.633 0.O96 

7 SOUAI» -O.SSO 0.030 

1 X CUBE *0.23& -0»024 

souareo beta MFIGHTS 
503. 4047322. 9S62UU134 
B WEIGMTS 

]S2.?51ft***««»a «10.?44 
INTERCEPT CONSTANT • ,260t674 



ANnVA T*BLE FOR POLyNCM|.iLs 



ERIC 



PEnUCTlON OUF TO LINEAR FIT, WITH t OF ■ O.OOO 

RESIDUAL S.S, - 1.000 OF • 137 RESIOUaL M.S. • 0,007 

F FAR LINEAR FIT • 0,060 "'^^ 

RFnUCTION OUF TO GE»iEflAL QUADRATIC FIT WiTH OF 2, « o.Aii 
RfnnCTION M.S. ■ (5.006 

PFSI0U4L 5iS. • 0,987 OF • .136 RESIOUaL M.S. t 0.007 

J Ff\fi OUAORATIC FIT . 0.R73 i w • o.pgj 

REDUCTION OUF TO CUAnRlTIe TERM ALONEi WITH I RFi m o.oi2 
F F0» OUAORATrC TERM ALONE - 1.066 * 

REDUCTION DUE TO OCnERAL CyBlC FIT WITH OP 3i • o 047 

flCOUCTION M.S. • 0.016 * 

RESIDUAL • 0.983 OF . 135 RifSlOUAL M.S. m 0-007 1-21 

^OR GENERAL CUBIC FIT « 2.218 



fOifCTIDN DUF TO CLRIC TC«P ALONE telTH 1 OF • . 0.034 
FOP CUflIC TFRM AL0N£ • A.a5B 



P^L-HOMtAL FTTTINO FnH ^ VARU«LE5*^RE AND TP flCOttC 139 nBitftVATlONl. 

RO RATING 

THP PflEniCTOP VAPlAflLEfX) is t^RE, ANO THf CPHfPjON V/ f» IlflLC (Yl 15 TP 3CCHC, 

TfST HffANS AND ^irANOAttC OCVTaTIONS 

I ^ « fl<A\7 0,183 

7 SQUAB 0.414 0.?2T 

3 X CUBE 0,?96 0*232 

* V 2,«06 I, 5*4 
COPPCLATION MATRIX 

IX 1,000 0,983 0,949 •O.rt^l 

? SQUAR o,9fl3 l.OOO 0^990 •0,OT5 

1 X am 0,Q4q 0,990 1 ,000 -O.ne* 

* ^ -O^oSl -0.0^5 -O.Ofl^ 1,000 

FfPST, SrcONO, ANO THIRD nEOREE pyLYNQMiAi,*;, 

MULTlPL>f R SOilAPC • 0.0A3 ■»■•■■■■■•*»■■■••■«•■■■■■■■■«■■■ 

MULTIPLE R ■ O.D^I 
N.i),F,l ■ f 
H.0,F,2 > 137 

r FOR ANALYST^ OF VAPllNCC On « ■ 0.362 
8FT% WETOHTS 
-O,0Sl 

C0NTRI«UTTO*JS TO MULTIPLE CORRELATION 

ANO PFORES^ION F4rTC» lOaoINQSi ^NO C0LU»'N) 
1 X 0.003 -1.000 

5'5UaREO BETA wflflXFS 

0.003 
n W/IOHTS 
-0.43U 

jN^TirPCEPT C0N5T4NT » 3»07* 

MULTIPLE R s6nAPC ■ 0#02l " 
MULTIPLE R ■ 0,U5 
N, O.F.I ■ jf 

F FOR ANALYST^! OF VARIANCE On « • l«A5T 
BFTi WEIGMTS 

0,4A9 •0,713 
CnNTPlHUTION^ TO >'ULTIPLE CORRELATION 

A^O REORE^SION FirTCR LOaoTNOSi 2N0 COLU^'N) 

I X -0,034 -0.3>A 

? 80U*R 0*053 -0,521 

souareo acta ^eights 

0.A48 0.938 
fl WpIOHTS 

5.T15 -9,^44 
iNTirPCEPT CONSTANT • 1.368 

MULTIPLE R SQ'URC • 0.041 umm 

MULTIPLE R ■ 0,204 

N.O.r,] ■ 3 

N, 0.^.2 • 135 

F PoP ANALY5M OF VARUWCE ON P • J f 94ft 

BFTi WETOKTS 

a.072 *ft,399 3,337 *" 

CONTPIflUTIONS TO ►•ULTIPLE CORRELATION 

iNO PEOPFS^ION FiicTCP lOaoInOS* 2^0 COLUMN! 

1 X -0,158 -0.252 

Jf 50UAR 0,A83 -0.371 

7 X CURE -0.284 -O.Ai8 
souapeo beta WEIOHTS 

9.A39 40,947 11.134 
n WFlflMTS 

26.233 -44,^17 22,482 
INTERCEPT CONSTANT • «lt8l4 



ANoVA TABLE roR POLYNCHlAtS 

flfnUCTTON DUF TO LTnEar FfT, wJTH 1 OF • 

flESTOUAL 5.S, • 0.997 OF • 137 RES;OUAL M.S, m O.OOT 

r FAR L1N|«R riT ■ 0.362 

PEnUCTTON OMF TO OE*jERAL CUaOPATIC F|T WITH OF 2« • 0.021 
REDUCTION H,<, • 0,OlO 
BfSinUiL 5,^. - 0.979 OF • 135 RE5I0UAL M.f, m o»007 

r rnp oiuoRirrc Fir > 1*457 ^ " 

REOiirTION riDF TO CUAOPATIC TERH ALCN£, MITH I CP* • 0.018 

F roP ouAORATir term alonE - 2,549 

RFOliCTTON our Tn OEnERAl SubiC FIT WITH OF 3, , q.OAI 
PEnuCTION M,S, II 0.014 

RE9T0UIL 5,9. • 0.959 OF • 135 RESTOUAL m.j, • o.OOT 1-22 

O FnP OENePAL CURIC FiT ■ 1,946 

3UCT10N r\\\f TO CURTC TEPM ALONE tilTH 1 OF « , 0.020 
fO» CimrC TrPM ALONE n ?.flft3 



RM RATING 

THf pntDtCTon VAflUflLEtXl IS SrtC, INO THE C«lTr«ION VipUbLK.Y) JS TP seOMt, 
TFST MItANS Awn STA^niHC Ofe'VUTlONS 

? soia« o.^oj o.jAfl 

X CURC 0,42^ 0.3S« 

* * A. ♦Si 1,925 
CORRELATION MATPfX 

* * ».000 n.96o 0.907 0.2H 
> SOUAfl o,Q6o },0i-^0 o,9fljj ft,^3* 
^ X CURF O.qOT 0.908 |,000 0.?4A 

Fiflsr, SECDNn, AND TMiPo 0£r,RCE pocynomuls. " ' 

^♦ULTIPIE « soiiAPr. ■ a. 044 

HUUTIPUP P • 0,?^ I 

F FnP ANALYSIS OF VAPIAnCE On P • 6«28S 
erri WEIGHTS 

CnNTPlRUTIONS TO f'ULTlPLE COrMEUATIOn 

aMO OFORF^SJOn FacTCP LOaoInOSi 2N0 COlUHI<> 

y < 0.044 UOOO 

50UAPE0 PEtA werOHT5 

0,044 
P WFTOMTS 

I^jTfpcEpT con«;T4NT « 3?6ni 

MULTIPLE P SOMiRg ■ 0«097 " " * 

•MULTIPLE R ■ 0.e3« 
^•O.F.l ■ ? 
N.n.F,? ■ 

F FnR ANALYSIS OF VARIANCE ON R • 4i034 
BfTi IrfEKiHTS 

«0«1A6 0«1Q4 
CONTRIBUTIONS TO ^-ULTIPLE CORRELATION 

i^O oeORES<;rON FacTCR lOaoIWGS# 2N0 COLU'^NI 
\ X -0,035 0,R<45 

7 SOUAR 0,09a o,9ao 

SOUaREO reta wciohts ^ 

O*0?ft 6,4H6 
B WFlflMTS 
•n.9T^ 2,1*1 
iNTr^CCPT CONSTANT ■ 3*968 

WULTTPLC « SOirAPE » 0.0^8 
MULTIPLE R ■ 0,260 

N.O.r.? > 133 

F Fnfl ANALYST*; OF VARIANCE ON R • SillS 
BETA WETOHTI 

0,746 l,77o 

CONfRlRUTIONS TO MULTIPLE CORRELATION 

aNO REOREStlON ^AC^CR LOaqInGS* 2N0 COLUMN) 

1 t 0,197 o.au 

? SOUAR -0,521 0.898 

1 » CUBE 0.A31 0.937 

souaped seta Wf iohts 

0.557 4,976 3.t33 
r WFtOHTS 

A. 346 -12,317 9,967 
INTERCEPT CONSTANT ■ 3»857 



ANDVA TABLE rOR POlyNCMIAlS 



REDUCTION nijr TO LInEaR FtT, WITH I OF ■ 0.044 



ERIC 



PFOUCTION our TO OFnEPAL OUAURATIC FIT KITH OF 2i ■ 0.057 
RPnuCTlON M,^, ■ 0.028. 

uF«;lmjAL S.<. ■ 0.943 OF • 134 RtStOUAL M.S. m (J.nOT 

F FnR OlIAORiTrC ^IT . 4*034 

RFOiiCTION OUF TO CUAOflATlC TERM ALCnEi WJTH I rF* • o.012 
f FOR QUAORATtC term A^OnE • 1.746 

RrmiCTION nUF to OEnfRal cubic fit hITH of 3i . o.OAa 

RFnUC!IO*J M,<, • 0.033 - 

RF^rnUAL S.5. • 0.932 OF m 133 RESIDUAL H.s. « 0,507 ^*23 

FrtR OE*<?ttAL Ct^^lIC FIT • 3.218 



FOItCTION OUF TO CUHIC TEM^* ALONE *iITM I OF '« . O-on 
FrtP CMofC TrPM aLOke ■ 1.554 * 



ERIC 



- — .n-.. „ 

POLYNOMIAL rrniNO FOM 2 VAMIAtSLtS^HMC ANO TP ^CnM^J. ,3/ OMSFPVAMoils. 

RM RATING 

TMP POEniCTOR VAfllAnLE(X) IS PMC, ANO ThC CRITfMlON VAn[ABLE(Y» IS TP SCORE, 

TfST mkans ano ^tanoapo deviations 

1 ^ O.POO 0.3^1 

? SOUAR 0.756 o,3*2 

C'lflE n.7|9 0.3AB 

♦ y ♦.♦53 1,925 

CORBFLATION MaTRIJI 

I * 1.000 0,985 0.953 0,15* 

I SQUAfl 0,085 1,000 0 99? Q AH 

.i. ^ p'l^* o,u7 1.000 

FTRST, ^SFCONO. ANO TmIRq ^^FHREE P^^LYnOhmls" " — 

MULTIPLE R SOfiARE ■ 0«024 """" 
MilLTIPLr R . o,|S(S 
N.O,F,| ■ } 
N.O.F.? ■ 

f For analysis of VARIANCE ON R ■ 3,107 
8FT* WEIGHTS 
0,15ft 

CONTRIHUTIONS TO MULTIPLE CORRELATION 

ako REGRESSION Factor lOaoingsi ?no coluhn) 

y V 0,0?4 1,000 

SOUAREO RETA WEIOHT5 

0.0 ?4 
R WrIGMTS 

O.flfl? 

INTFRCEPT CONSTANT ■ 3?747 

MULTIPLE R 50MARE ■ OtOZQ " ■■■■■ 

MULTIPLF R - 0,1A6 
N,0,F,| ■ ? 
N.O.F,? . 134 

f FOR ANALYSIS OF VARIANCE ON R ■ l«90? 
BFTi WFiOMTS 

-0.159 0.3'rt 
CONTRIRtlTIONS TO MULTIPLE CORRELATION 

ANO REGRESSION FjcTCR LOAOlNGSt ?N0 COLUHnj 

1 X -n.0?5 0.9*2 

? S'lUAR 0.052 0.986 

SOUaREO QETa -ErGHTs 

0. 025 O.irt? 
R WFIGHTS 

•0,B94 l.Hrtl 
rNTFRCEPT CONSTANT . 3.8o7 

MULTIPLE n soiiARE • o.aH " 

MULTIPLF R • 6.177 
N,0,F,| ■ ^ 
N,0,F,2 ■ 133 

f For analysis of variance on r • i,49« 

BETA WEIGHTS 

1, flS? •4,1a6 2,7l0 ... 

CONTRlRUTrONS TO MULTIPLE CORRELATFON 

ftNO REGRESsrON FACTCR lOaoFNOS* 2N0 COLUHN) 
\ X 0,290 0.A86 

? SOUAR -0,712 0.927 

3 « CURF 0.453 0.947 

SOUaREO RETa wFrOHTs 

3.430 i^.non 7,345 

B WEIGHTS 

10.440 -24,6511 15,610 
INTFRCEPT CONSTANT ■ 3.795 



ANOVA TARLE FOR POLYNOMIALS 

REnUCTlON our To LINEAR FfT, W|TM 1 'of""'""'"JJ""""'"""""'""""''' 
RCSTOUAL S,S. ■ 0.976 OF ■ 135 REStOUaL x.S . a a«t 

F FOR LINEAP FIT ■ ^.387 hii5IDUAL ,8. ■ 0.007 

REnUCTlON OHF TO GEkEPAl QUaORATIC fit nlJH OF 2, ■ 0 ^^7^i 

REOHCTION M,^, . 0.014 

RESIOUAL S.S, ■ 0.972 OF • 134 PES?niiAi m • • - 

F FOR QUAORATIC FP . l.9n? RtSlOUAL M.5, . ^^^^y 

REoncTiON niiF Tn cuaoratic tern alone, wrrn i (,r. o o.ofli 

F For QitAORATrC TERM AL ONE . 0.*32 

REnitCTION nuF TO OEnFRAl CUBFC fit with of 3, . All 
REOnCTlON M.S. ■ 0,010 
REsroUAL S.S, . n.969 OF • 133 RESIDUAL M,s, . o.^^^. j^24 

IR RFNFRAl CORK FIT ■ 1.428 



UCTION nUF TO OURTC TEMH ALONE I TM I OF ■ . 0.004 
CliRIC TFPM ALOK'E m 0.493 ' 



RM RATING 

The PRCOICTOP V4qui,tC(Xj IS G«E, ANO TmE CfllT(!«ION ViPHBLCttJ M Tp ScoRC. 

TfST MEANS ANO STA^niwn OCvlATtO»vS 

' X 0.Q9? 0.007 

? SOliAW O.O'Jf 0.013 

X Clm^ 0,992 0.019 

^* ^ 4.453 1.925 
COPBELATION MAYRtJI 

i sauJa I'"*;; }'^^^ ^'^^^ 

1 X CUBE KpoO 1,000 1 ,000 O.oAt 

_ ^ 0.044 o,04<i 1,,)00 

FIJI<;T, SPCfi»rff>, AND TMlKQ nCC»HEE PWUTNOntALS. 

MUCTIPLE « SO«ia»e'»" o!o4" 
HuLTfPLf « ■ 0.341 

r rnB ANALvsts nr vapuncC on R ■ 

BFT* WEIGHTS 
n,04i 

COMT»!RUTlr>N^ TO KUCTIPLC CObPELATIOn 

4NO RCOBEi^tON FacTcP lOaoI^OS. 2N0 COLUMN! 

! « 0.002 r.ooo 

SOUiPEO BET* weiOHTS 

0.002 
« wrtOHTS 
12*035 

r».fTr»cePT CONSTANT ■ *7.55l 

HUlTlPLt » SOiU«c'«** 

•^ULTrPLE « • 0.374 
N.O,r,l ■ ^ 
0,^.2 • 

f ro^ ANALVS?5 Of VAPIANCE ON R ■ lO*Bfr« 
BFTA WCIOMTS 
-51.0S3 51.0QS 

CONTfllBUTIONS TO MULTIPLE C0«PCLaT10n 

iNO »E3»E-^CI0N rAcTCB L0*OtNOSf 2N0 COLU**N| 

1 X •2.092 0,110 

? SQUAP 2.231 o,U7 

SOU4RCO BETA •.ftO^'TS 

lNTr«cepT CO^^KTfltNT ■ 7356.34* 

M(<tTlPLe • 0.37? 
N.O.f.l •3 

N.0«F.2 ■ 133 

r Fo» ANALysT*^ or )<»»lANce on r ■ 7.131 

BFTA WEIOMTS 

-15,047 15.563 

CONTPIBUTJONS TO MULTIPLE COftPfLATION 

*N0 PEOPE^^TON PacTCR LOaOInOS* 2N0 COLUMN) 

1 X -1.436 O.llO 

7 SOUAR 0.B53 0.117 

? >t CURf 0,722 0.125 

SOUjPEU BETA vr!0**T$ 
2^fi,127 3Rl,3»6 242. »93 
R wrlGHTS 

AO715I0, 930 
iNTrftCEPT CO*i«;T»NT • 5796.962 



ANrtVA TARtE rOR POLVNCHtAlS 

FIT. WITH 1 OF 



PfniPCTION our Tn CUAnflAtJr TER« ^LCwr- yfTw l 

r roR ouAOPAMc term alone • 2^47!' ^ ' ^'^^ 



RM RATING 



TfST MEANS 


ANA STANnanr 


nEVtATlONS 


1 < 








0.451 


0.252 


3 t cmt 


0.3*2 


n.2S3 


4 Y 


♦.453 


1.925 


CnPftJTLAT ION 






t X 


1 .000 


0.95ft 


? SOIlAP 




1 .000 


1 X CUBE 




0.9b5 


A ¥ 




0.3^0 



0»89ri 0*^66 

0.9fl9 (1.190 

\.0{>0 O.'^fli' 

. 397 I , rtOO 



riPsT» SECONH, TMiF;n nfr,pEt p^lyno^^ials. 



sea 



KiLTlPLE « SOiiXPE > 0.13A 

N.n.f=Vr ■ 1 
N.n.r.? • j39 

F FnP ANALV'I^ nr vapiancE on r ■ ;;d»fl45 
BrTA WEIGHTS 
0,3A6 ^ 

CnNTOIHUTIONS TO ^'Ul.TlPLE COBPELATIOn 

. A^o «frjRes«;toN f 4rTCf* l04oIngs» 2no C0LU»"Nt 

1 X ^^,134 1. 000 

SnUAOEO PETA wETOHTs 

•0.134 
P .WFTGMTS 
3.n3T 

INTFPCEOT C0n<;T4NT • 2.533 



MULTIPLE « SOUAPE a 0.1*3 
MULTIPLE ^ ■ 0,391 
N. O.F.I ■ 7 
N.(V,F.2 ■ 134 

F f^tP ANALYSIS OF VAPIANCE ON R ■ 12-l03 

fll57a WEIGHTS 
-6;(lft9 0.475 

CONTPIBUTlrtNS TO MULTIPLE CORRELATION 

iNO REGPES<;iON FacTCP LOaqINGSj 2N0 COLUMN* 
1 t -0,033 0.935 

? SOUAfl 0»leA 0.99e 

SOUaPEO peta wfights 
o.ooe o,??6 

A Weights 

-0.739 3.A10 
iwTFPCEPT CON^TA^T ■ 3»276 



MULTIPLF P SOIJAPE ■ O.iS*. 
MULTIPLP R ■ 0.3<52 
N^n.F.l ■ y 
N,n. F.2 -133 

f rnP ANALYSTS 0^ VApIiVCE ON « • 8.0*2 

bfta weights 

-0,260 0.<5^9 -0.324 
CONTPIBUTION^ TO MULTIPLE CORRELATION 
• 4N0 PEGPE5SI0N FAcTCR LOftoI^GSt 2N0 COLUHnj 
\ < . -0,055 0.933 

? SOUAR 0.374 0.99« 

1 t CUBr -0,126 0,987 

SOUiPEO PETA VET0>*TS 
0,0«B 0,^19 0,109 

fl wriOHTS 

-2.159 7,3?o -2,4>2 
INTERCEPT CONSTANT ■ 3t347 



4N0VA TABLE ''OR POLYNOMIALS 

PEOUCTTON nuF TO LTNEAft FfT, WITH \ OF ■ 0»134 " " 

PE^inUAL S.S, ■ 0.A66 OF ■ 135 flES!OUAL «rS. ■ OtfiOA 

F Fnp t!»'E<P FIT ■ 2o.fl45 



f^EnucTFON our TO oei>^Epal ouaopatIC fit iflTH of 2i ■ 0.153 

REOnrTTON M,^, ■ 0-077 

or«;inUAL S,S. ■ o,p47 OF • 134 REStOUAL M^J, « " ^^^O.flOA 

F FnP OUAnf?ATIc FIT . 12.103 

PFOUCTION OMf TO CUAnRATIr TERM ALOnEi WITH I fjFi • 0.0\9 
F FOR OUAOPiTfC TERM alOnE ■ 3.0*6 

RFnilCTlON our TO OENrRAL CUeiC FIT WITH OF y\ n 0,114 
RFOUCTlrtN M,^, ■ 0.05l 
PESIOUAL 5«n, ■ 0.B46 OF ■ 133 BESIOUAL M»s, • o,q06 1-26 

Q POP OFNFRAl cubic fit ■ 8.042 

IIJCTION niPF TO CUt^lC TfMH ALONE HITH I OF • , 0,001 
fnfl CitniC TFPM ALOSE 0,0fl6 



/ 



TMC PPEniCToP VA«URlC<X) 15 SMF, AND THE CnlTjfHrON V AO I ABLt (Y) " I S TP SCORC, 



TFST MEANS 


ANn STASnA«n 


nCviAfioNS 




I X 


o.?eo 


0.263 




> SQUAR 


0, j5f» 








Oi 1 lo 






4 Y 


5.783 


2.425 




CnPoCLATIOM 


MUPIX 






1 X 


1 .noo 


0.938 


0,85/1 


^ SOUAR 


o.Q3e 


I .000 




1 X CUR^ 


0.A5P 


0.9(10 


1 .00(1 


4 Y 


0. 19<J 


0.2*6 


0.299 



TfRST, SfCONn, AND TMlS-n nfGJ?feE P^L/NOHIALS, 



HULTIPLF R SOMARK ■ 0.040 
Mi'LTrPLf R ■ 0.199 

N.n.F.i ■ ) 

N.n.F,? r 150 

F FOR ANALYST^ OF VARIANCE ON R ■ «.2l7 
BFTa WEtOHTS 
' 0,199 

CONTOIHUTIONS TO MULTIPLE CORRELATION 

AnO RFORpSStON Factor LOAOINOSi 2N0 COtUHN) 
■ 1 X 0.040 1.000 

SoUaPEO RCTA wFIOHTJ 

0.040 
p wrlGHTS 
1 .711 

r^TrRCCPT CON<:TANT ■ 5.3o* 



MULTIRLE R SOtiARE • 0.0*9 
MULTIPLE « • 0.2«2 
f'.n.F.i ■ p 
N.0.F.2 ■ |49 

F For analysis of variance on R ■ S.483 
BFTA wEIOMjs 

-0.7S8 0.4ft4 
CONTRIRIJTIONS TO »'ULTIPLE CORRELATION 

4N0 RE0RES<:I0N FACTCrt LOADINGS. ?N0 COLUMN) 

\ X -0.051 0.7«2 

7 50UAR 0.120 0.940 

souareo reta weights 

0.067 6 .?1<> 
0 WFIGMTS 

-2.213 4.774 

I^TrRCEPT C0N<;TANT s S.6S7 



HULTIOLE ft SQUARE ■ 0.069 
MULTIPLE ft • 0.263 
N. D.F.I a 3 
N.D.F.2 ■ 144 

F FOR ANALYSTS OF VARIANCE ON R • 3.656 
BFTA WEIGHTS 

-0,142 6.1^3 0.231 
C0NTPlBUTinN5 TO »'ULTlPLE CORRELATION 

iNO PEORES^JION FAcTCfl UOaqInGSi 2N0 COLUMN) 
1 X -0.028 0.7^9 

? SQUAR 0.038 0.934 

J X CUBE 0.060 0.9^5 

SOUAREO ACTA k«eiOHTs 

0.020 0.073 0.0S3 
P wrIOHTS 

-1.218 1.403 2.39e 
INTfRCEPT CONSTANT ■ S.627 



ANnVA TARt.F FOR POLyNCMjaLS 



PfnUCTION 0\n TO LfNtAR FIT. WITH I DF a 0.046 

PF<;lOUAL S.S. ■ 0*960 DF ■ I50 RESIDUAL M.S. ■ 0.006 

F FOR LINEAR riT ■ «.2l7 



QFnUCTION nnF to general CUaOWATIC fit with of 2i ■ 0.069 
RFOMCTION M.^, ■ 0.034 

Rf«;lDUAL S.5. ■ 0.931 OF • 149 RESlOUAL M.S. • o*004 

F FOR QUADRATIC FIT ■ 5.483 

repijCtion nuF ro cuaoratic tern alcnEi with I C^t B 0.029 

F Fnfl OUAORATIC term AlONE ■ 4.600 



RFniiCTlON nUF TO <*ENFRAL CtfllC FIT WITH DF 3f « 0.069 
ftfnrjCTION M.<, B 0.023 
I "ESIOUAL S.S, ■ 0.931 DF • UB RESIDUAL M.S. • 0.006 



FOR OFNFOAi. riiRlC FIT • 3.656 

DMfTiON ntjr ro curic tfRm alone with i of • , 0,000 
FOR cubic TrOM ALOnE ■ 0.071 



t 



f 



ST RATING 



7FST MEANfi ANn STANOaRC DCVUftONS 



? SOUAR 
4 V 



0.*52 
5,7*53 



1 X 1.000 

? SCUAP 0.9^2 
a X CUB^ 0.<J23 



3V0 
.1^7 

.972 
.000 
.987 
0.055 



0f923 
0f987 
If OOQ 
d.Q69 



1*000 



r. 



>IP«^T, SfeCO^jn, AMD Th1*!0 PtEGRtt pulvnomials. , 

•-MLTTPLK R SrjMAPt ■ 0.0^3 \ 
MULTIPl.l[ R B O.OSfl 
N.r.F.l a 1 . - 
fj,n,f»2 a )50 

F FnP AMALYSI^ flF VARIANCE ON R ib 0*50^ 

o.osa 

CONTRIBUTIONS TO MULTIPLE CORRELATION 

iNO RtGRE«5<;rON FicTCR lOaoINGSi 2ND COLU^'N> 
\ % 0,003 l.OOO 

SnUAHEO BETA wfiCHTS 
0.003 

S ^FlGMTS J 
0.36? 

I^jTtRCEPT COwcTaNT « 5i5B4 ^ 



MiilTlPLE R SOliAPE ■ O.OflS 
MULTIPLF R B 0,058 
N.O.Ffl a ? 
M.r,F,2 a 149 

F FoP A^JALVSt<; OF VARIANCE ON R « 0«295 
SFH WEK5MTS 

COKTOlBUTtONS TO MULTIPLE COPRELATIOn 

*K0 REGRESctON FacTCR lOaqINGSi 2N0 COLUHNJ 
[ K 0,005 0.9'^5 

? SOUAR -OtOOl 0f9*3 

SOUaREO BETA'v^jgvTS 

0.007 O.OM 
B wrIGHTS 

0,51* -0,170 
IMTrRCEPT C0»J«;T4Nr B 5!577 



«»iLTtPLF R S05IAPE ■ Ofifl2 
HIJLTIPLF R - 0.320 

w,i\,F.i ■ . :i 

N,r.F.2 ■ |4R 

F FOR ANALYSTS OF VAplANCE ON R ■ 9*634 
PFTa wCtGHTS 

CnNTPIBJTIONS TO MULftPLE CORRELATION 

AND PFQRESStON FacTCR LOaoINOSi 2N0 COLUHn^ 
T V % 0»2e3 Q»\^Z 

? SOUAR -0.648 0.1*2 

3 X ClIBF 0,468 0.204 

. SoUaR^O beta wEtGHTS 
?3,A59 13B.?-.fl 51.513 
8 wrtGHTS 

3ft, 272 •*7n.lkn4 90. 161 
INTERCEPT CONSTANT ■ 5.410 



ANr)V4 TAftL*^ 'CR POLYNCWtAl-S 

OEnuCTTON our TO LInEAR FiT, WITH 1 OF b O-t^Oi"""*' ^■■■•■■■B«aa 

REStOUAL S.S, ■ 0.997 OF • 150 RESIOUAL m.s. • 0*flOT 

F FnR LINEAO rir b 0.S09 

OEHUCTTON Ol»» TO GENERAL GUADRATIC FIT WtTH OF 2, m 0.003 
PEnnC^ION M.s, ■ 0.O02 ' 

t?FSinUAL S.«l, ■ 0.997 OF m U9 RESIOUAL H,5, « ft#007 

F FOR OUAORATK FIT m ©,299 

RFDIJCTCON ni/F TO CUAD^ATtC TgRM ALCNEi WITH I CFi m 0«000 
F FnR OUAORAtrc TERM ALONE a 0*009 

RFDUCTlON OUF TO OEnFRAU CUBIC FIT WITH OF 3l b 0»102 
RFnilCTlON M.9, ■ 0#034 , . 

RESIOUAL • 0.B9S OF « 140 ftCSlOUAL H,|, • O.OOA 1-28 

O OFNEPAt CUBIC FIT a ?5,634 

PDiP"tON nnF rn cubic teh*' alo.jE with j of ■ , . 0.09O 

^*\L^ CtJBIC TFflM ALONE a J6,339 



P.^l .•.r.HtA^, rfrTU.O rnM j V*W| AUL« X-Oflf 4^0 tP SCOPE* |lj Onj^^flVATIONl, 

ST RATING 



J « 0»A97 O.ltfT 

' SaM*ft OfA^O 
> » CUHC Q,790 0.?2(3 

t * l.nOO 0.969 

7 S*2iiA» a.'?*9 NOOO 

^ » ci;Br o.<>m o.9«a 

H't?lPvr Q SOcAPt ■ O.OjO 
♦•VLtfPtr O ■ 0.099 

•••o.r.i ■ I 

r r^o *«i*i.ysr^ or vAoiiNCt Of< ft • li49o 

Cn^1«>m»iT !r>N5 TO »»UlT|PL€ C0RPEL4TI0N 
) ( 0^0 10 UOQO 

H.TrO(;rDT C0»*%T4HT ■ *«630 

*. Ln«>vf lo'TAPe ■ 0.IJ4 

I ■ y 

••♦O*'.? « |49 

f ANALrSTS Of V4nJ*NCt On fl ■ 11.550 

-l,?9» 

C^>N?»tP<Jl TO »'^JLT|PL£ COiJ»£L4T|0n 

i « -''sl^B 0.271 

» 5'iU«ft n,2«3 0.499 

ScuiflfO «€T4 -flOt'Ts 

»i«^.y^5 17.1 t1 

IvTfOCCPT C0*<^T4«<T » 6.437 

>*• LT JPLC 'J 50«'»9e • 0> I 'I 
»<bir»OLF « « 0.4?2 

r r;*» AN«(.v5r^ or VAoUNCt 0« ff • I0i*92 

),^*iy *^.TT7 4.19? 

CC^^or^iiT fOHA TO *'ULTIPLC COB«tL4TI0'l 

» t 0,1*7 O.i^S 

> S0U4R «1.0Sft 0.43J 

> « Cu»^r 1 ,067 0.575 
5or«ofo *^CT4 *#ftO»«r^ 

?»^4) 33,:»T4 i9.?e« 

>t .«»9 -61. 40, 35l 
iKTracCPT CO>#^T*Nr ■ 5.«2S 



0.914 U«n99 

0.909 0,193 

1.000 0.2*3 

A. 243 l.nOO 



fif^t/CJinM Our TO LT^e*Q fiT, *ITh l Of ■ O.OlO '" 

of^tOu*c ■ 0.990 or ■ 150 SESIOUAL • OiOOT 

r f '^o tI*»r4P r f T ■ I .igo 



or-^i^rfros mrr TO Of^rc^L -QUADRATIC rtT ilTH or 2« ■ 0.134 
0rrurt\OM «.S» ■ 0.06? 

ofimuAL ■ n.B66 Of ■ 149 ftESlOUAL M.S. • 0.006 

r rAO.cu*0«4t jc r|T . 11,5^0 u wv« 

nrr<»CTto« our to cuAn«*Tic tcrm alCnc, m\jh i cr» • 0.124 

r OUAf^OATfC TtMH ALOnE ■ 2l.*0a 

firoMCTjfti* nnr fft ot^rwiL cubic nr kith or 3i ■ o,i7S 
orr^rfiON ■ o.o*^9 

of<tnu4L • n.f^zi or • i48 resioual m.s. • o,oo« 1-29 

^ _,o af»«e<>Ai, cimtc riT ■ 10. 692 

rTio*. r^ur ff» cijt^ic riw alone: ^iiTH 1 or ■ fl«044 

- CmtC TfBM ALO^^ ■ 7.904 



ERIC 



TFST MEANS A^^n stanoaho 


nEVlATlONS 






\ X 0.A03 


0.P07 






? SQUAft Oi406 


0.237 








0.236 






4 Y 5,783 


?*429 






COPOELATION MATOIS 








1 X 1,000 




0,92t 


0.23* 
0.2^5 


? SOUAn 0,Q73 


1. 000 


1 X ClfflE 0,921 


0,QB9 


UOOO 


0,2A3 


4 Y 0,?34 


0.2«>5 


0,^63 


I ,ftO0 



FTR<;T« SECONn, AND THifln nCC'ftEE P^lYNOMlAUS, 



MULTIOUF R SOtiAftE ■ 0t053 
MltLTlPL» R ■ (J. 234 
N,n,r,l - 1 
N.r.r,? ■ 130 

F FoO A^JAUY5TS OF VARIANCE ON fi ■ fl.707 
BFT4 KFIGHTS 
n,?14 

C0NT0IRUT10N5 TO ►'UUTIPUE CORflEtAFlON 

iNO BEnni:S<;roN factcr uOini^GSt ?no couuhn> 
T V o,o;s uooo 

SOUlflCO PETA wFtOHTS 

0.0^5 
B WrtOMTS 

?.746 

iKTraCtPT CONSTANT • i'l^S 



MiitTlPtC R SOUARE » OtO^O 
MUtrlPtC R > 0,2«3 
N,0,F,1 • j 
N.O.F,? • 149 

F rnR ANAtYSi^ OF VARIANCE ON R ■ 6t467 
9FT| WEtflHTS 

-0,426 6»A7<> 
CONTRlnUTlONS 70 K^M.TIPUE CORREtAllON 

^^0 RFORES^ION Factor uOaoINOSi 2N0 COLUMN^ 

\ « •0,K00 0ta29 

P SOUAR 0,lflO 0.936 

souapeo beta ^eio>«ts 

0.182 6.4AI 
« wrtGHTS 
•4.999 6.«»^7 

iwTfDCEPT C0N<;TANT ■ 5»9fl2 



MULTIPtE R SOMAPC ■ 0.^23 
MULTlPLr R ■ 0.351 
N,0,F*l ■ 3 
N.O.F, 2 ■ 144 

F FAR ANAtYSts OF VARIANCE ON ft • 6t925 
BFTi WEtOHTS 

-2,679 A,nS -3.314 
CONTfllRUriON? TO I^ULTIPLE CORRELATION 

AKO REGRESSION FACFCR lOaoINOSp 2ND COLUMN) 

\ t -fl.62s O.ft^l 

? SOUAR 1.624 0»754 

t X CU^E "0.873 0»T5l 

SQUIRED BETA '^FIGHTS 

T.W9 57.f44 10,98« 
B *<EI0MT$ 

-31.415 6?.A«;3 -34.660 
INTERCEPT CONSTANT ■ 9.^Al 



ANnVA TARLE POP POLyNCMIALS 



PEoUCTTON DUF TO LINEAR FtT, WITH I DF ■ 0.055 

RESlC^JAt S.^, ■ 0*949 Of • 150 -RCStOUAL >*»5. • 0»0fl6 

F F^R LINEAR rlT ■ /»,70T 



REnUCTION OMF TO QEnERAU CuaDRATIC F!T wlTH OF 2» ■ 0»0S0 
REDUCTION M,S. ■ 0.040 

oE^ilOUAL S.n^" 0.920 DF • 149 flCsiDU AL„M , j , • o»dO« 

F rnR CUADRATTC FIT . 6. 467 

RE0»»CTION OMF 7ft CUAnRATK TERM ALOnEi ^ITh 1 eft • 0.025 
F FnR QUADRATIC TERM ALONE • 4.05O 

SFruCTION 0»>F Tft OENfRAt ^WC FIT WITH OF 3i « 0,l?3 
RFCliCTlON M.5. • 0,0*1 
RESIDUAL 5.^, m Q,n7't DF ■ 149 RESjDUAL M.I. • 0.004 



Q FnR OF^CRAf CUniC FIT ■ 6.925 

lEniCTlON miF TO CUHlC TEP^ alone hITH I OF • , . 0»041 
FnR CUBIC TrOM ALONE ■ 7.296 



ST RATING 



1-30 



POLVKOMML FTTTINO FOH 2 VAP | AoLtS-Spg AND M> *^Cr)Hg, 37 0RSenV,5TlflN5f 



TM RATING 

Jut PWCOTCTflP VAfllAfluCCX) is SR£ 1 *N0 THE C«ITC«I0N VAhM8LE|Y> IS TP SCCRC. 



TFST MEANS ANn STAN^aRC DEVIATIONS 



1 K 


0.17} 


0. 194 
0.U9 








? SQUAR 










9 X CUBE 


0.03! 


0»109 








4 V 




1.936 








Cr>R»F.LAT10M 


MATRIX 










1 n 


1 .000 


0.909 


0.79i 


0< 


.198 


7 SOUAR 


0.Q09 


uooo 




0< 


,nS2 


1 X CUBE 


0.791 


0*9'2 


1 .000 


•0 1 


,nST 


4 y 


0. |VA 


0.052 


-0.057 


1 . 


lOOO 



F1P^T» SECHNn, ANO T^;If;o nEfjBEE polynomials. 



MUI TIPLE R ^OuflRE » 
MULTIPLE R ■ 0»l*>« 

N.n.F.i • \ 

N.O.P*? ■ 37 

F FOR ANALYSTS OF V/lpIANCE ON R • 1.903 
SeTi WEtQHTS 
0,198 

CONTfllRUTIONS TO ►'ULTlPLE CORRELATION 

aKO REGRESSION FAcTCR LOiOlNGS. 2N0 COlU^'N) 
\ V 0.039 1.000 

SnuaREO BFta weights 

0.019 
p UFIGHTS 
?,0?4 

InTfRCEPT constant ■ 4.932 



MULTIPLE R SQUARE ■ 0.129 
MULTIPLE R ■ 0.359 
N, O.F.I • ? 
N.O.F.? • 3« 

F FOR ANALYSIS OF VARIANCE ON R ■ 2t«96 
BFlii V^EIOHTS 

0.fl39 •O.TrtA 
CONTWinUTIONS TO MULTIPLE COQRELiTlON 

aNO regression FAcTCR LOiOlNCS. ?N0 COLUKNl 
T t 0.169 0.5S1 

? S0U4R -0.036 0«144 

SOUiREO BETA WEIGHTS 

0.698 6.496 
p WFIGMTS 

fl-SSfl «l6.14R 
I^TFRCEPT CONSTANT ■ 4»490 



MULTIPLE R SQUARE ■ 0-?17 
MULTI<»LF R ■ 0.466 
N.O.F.l ■ J 
N.O.F,? ■ 3^ 

F FOR ANALYSTS OF VARIANCE ON R ■ 3.230 
BFTa WEIGHTS 

•0,463 3.047 •2,65l 
CONTRtPUTIONS TO MULTIPLE CORRELATION 

AND REGRESSION FAcTCR LOADINGS* 2ND COLUMni 
\ X -0.09? 0.424 

? SOUAR 0.198 0»lU 

-K ¥ CURF 0.191 -0.122 

SQUARED BETA WEIGHTS 

0.?lS 9.?f49 7.629 
B WFlGHTS 

•4.749 44,7^4 •48.424 
INTERCEPT CONSTANT m ♦•BO? 



ANoVA TABLE FOR POLYNOMIALS 



RFOUCTION PUP TO LTnEAR F^Ti WITH 1 OF ■ 0.03<l 
OESIOUAL S.S. ■ O.96I OF ■ :$7 RESIDUAL M«s« ■ 0*024 

F FOR LINEAR FIT ■ 1 .903 



ERIC 



RtnUCTinN TMf TO GENERAL CUaDRATIC FH mITh OF 1% ■ 0.129 
REDUCTION M,s, ■ 0,0*4 

RESIDUAL S.S, ■ a.BTl OF ■ 36 RESTDUal H,3« . 0*o24 

F foR OUAPRATTC FIT ■ ?«696 

RFO»^CTION OUF TO CUAoRlTIC TERM ALCnEi WITH ! tf % ■ 0.090 

F FnQ QUADRATIC TERM ALOnE ■ 3.700 

■■■■■ • • • 

REDUCTION OUE Tft GENERAL CllBjC FlT WlTH OF 3» . 0.217 
RFnnCTlON M,s, ■ 0.072 
RESIDUAL S.S, . 0.783 OF ■ 35 RESIDUAL M,s, o 0.022 1-31 

^ .»R GENERAL CUBIC FlT • 3.230 

iCTION DUF TO CUfllC TERM ALONE hlTH 1 OF ■ ^ 0*08'* 
>R CUBIC TfRm alone ■ 3.944 



POIYNOMUL FTTTINO FOR 2 V AH I ArtLE S-PHE anO TP ^CO«E* J9 OnSEft T J OnS . 

TM RATING 

THE PQEnlCTrtP VAniAMLC(X| 15 PRE » AND THE CfllTgRlnw VAP!AflLC(V) IS Tp SCO«t, 



TfST MfANS ANO STANOaPO DCVIaTIOnS 

1 V OiASq 0«3S4 

? S<3l/A{| 0.129 n.p'^e 

^ X CUiif 0*?*9 0.25« 

* V 5*?82 |,96A 
CftPPCLATrO** MATPrX 

1 X 1,600 0.9T1 

2 SOHAR 0,Q7i UOOO 
? X Ct/9e O.QM 0.<9»2 

* Y 0.?*3 0.2«l 

FiP<iT, sEc^w^. ANO Third o^roReE p^lynohials, 

KULTlPLf » 5'5"iAOE • 0.099 
KULTIPU« R . 0.2«3 
N<f>,F,l ■ T 
N.D.F,? . 37 

F FOP ANALYSIS OF VARIANCE ON R ■ 2.329 

eriA wEr<5HTs 

0.2*3 

CONTRIHUTIONS TO MULTIPLE CORPELATIOn 

AND OEGPCS^ION Fa^TCR LOaO/NOS« ?N0 COLUMNI 
1 * 0,0«g 1.000 

souareo reta weights 

0,0^9 
B WriGMTS 
1 .366 

INTERCEPT CONSTANT ■ A. 667 

MULTIPLE P SOiiAPE ■ 0,69a 
hULTIPLC P « 0O06 
N.O.F.l ■ 7 
N,0,F.? ■ 3A 

F FOR ANALYSIS OF VARlANCC ON R ■ 1,857 
8FT4 WEfOHrS 

-0,502 6, TAP 
CONTRIqUTtONS TO MULTIPLE CORRELATION 

AWO nCORFlSION f acTCP LOaoZngS» 2N0 COlU^'WI 
I « -0,122 0,796 

? SOUAR 0,216 0.918 

SOUaREO BCTa wpiOHTS 

0,2S2 O.SQl 
P WFIOHTS 

-2.«21 5.T5A 
INT'-PCEPT CONSTANT m A. 879 

MULTIPLE P SQUARE ■ 0,153 
MULTTPLC P ■ o»39i 
N.0,F,1 ■ 3 
N,D.r,;» ■ 35 

F FrtP ANALYSTS or VARIANCE ON P ■ ?»U2 
SETA »*EtGHTS 

-3,0B3 6.7"6 -3,«i79 
CONTQJfilJTIONS TO VULTIPLE COPRELATJOfrf 

aNO REGPrSSlON FicTCR LOaoINGSp 2N0 COLUHn) 

\ t -0,750 0.622 

? SOUAR 1,906 0.717 

1 t CURE -1,002 0.716 

SOUaPEO B€TA weiohts 

9,506 46,044 12.T8A 
8 WrrOHTS 

•17,309 4S,Sfl(| -27.737 
INTERCEPT CONSTANT • 5.1o3 



0.911 n,?A3 

0.982 0.2^1 

1*000 Oi?Sd 

0.2«o l.'^OO 



ANOVA TABL€ rOR POLYNOMIALS 



RFouCTrON our 70 LINEAR FfT, WITH 1 OF • 0,«S9 

PEsIOUaL 5.S. • 0.9*1 OF • 37 RESIOUaL «.S. • 0,02l 

F F'^R LINEAR riT ■ ?,329 



RFnUCTTOM OUff TO GENERAL OUaOPATIC FIT i<lTH DF 2i • 0.09* 
PFOIICTION M,S, • 0.0*7 

OFStnUAL S.s, . (1,906 OF . 36 RESTOUaL H,8. • 0.025 

F Fnn OlIAORATtC FIT « 1.857 «»o«3 

PEOiiCTTON nilF TO CUArvRATlC TERH ALONE, WITH 1 CFi • 0,034 

F FAR QlJAOPATTC TERM ALOnE m 1.363 «twj-» 



PfOilCTION OUF TO OEwFPAL CU8IC FIT WITH 3« . fl.ist 
PFOIICTION M,S, • 0.051 
PEsrnUAL 5,S, . 0,847 OF . 35 RESIOUaL H.S. t 0.024 1-32 



ERIC 



,JR OFNCPAL CUBIC FIT • 2aU 

irTiON nijF TO cuRic terh alone kith i of • , 0.06O 

►P Clinic TrRM ALONE • ?,47o 



TM RATING 

Twc ppcntcroR vaPUPtccjo is ope* 4no the cRiT^moN VAPtieuEcr) ts tp .scoflc* 



TrSt MEANS <Nn STINoafiC OEVrATlONS 

1 « O.flTl 0.1^3 

> SOlJAP 0,768 0.2)0 

1 « CUQC O»720 0.2*8 

CORRELATION M«TPfX 



i e«..J« ^'^^^ O'''*^ 0.6BII 0.186 

? SOUAfl 0.052 1 .000 o.9e< oIlSo 

1 « cuoc / o.aeP o.9?6 i.ooo VMl 



•t. ^''^^ 

FtPsT, SE'inNf), AND THifio nr^Rft pvJl ynOmi als. 



MULTIPLE » <if)1i/^RE ■ 0.035 
MULTIPLE R ■ fl,lflA 

W. 0,^.2 ■ 37 

r rnH analysts or vapIancE On r • 1.327 
BrTi w^rOMTS 
n«i86 

COWTPIflUTjON^ TO >'i/LT(PLE COftPELAriO^ 

AND REGRCS<;iON FAcTCfl l0»01nGSi 2N0 COlUMn) 
] ^ 0.035 UOOO 

SQUARED PCTA WfTOXTS 

0.015 
B WffOMTS 
2.131 

I^TfiPCEPT CONSTANT - 3.*?6 



MULTIPLE R SOMAHE ■ 0.035 
MULTIPLE R ■ 0.187 

N.o.r«i ■ ? 

f FOR ANALYSTS Of VAPllNCE ON fl • 0.6<^6 
OFTa WEtOHTS 

0.2S? •O.ftTS 
CONTRJRtjTlONS TO MULTIPLE COftPELATIO/^ 

AND «FOPfS«fON FACTCR lCioINGSi 2ND COLUMNI 
t ^ 0,0*B 0.9'i'3 

? SOUAQ -O.013 0.907 

SQUARED eCTA '-'EIOHTS 

0.066 O.nnA 
B WFlOHTS 

2.944 •6.7^4 
T»>'TrPCCPT CONSTANT • 3.272 



MULTtPLf « SCiiARE ■ 0.0^5 
MUtTIPLE R ■ 0.291 
M.n.F.l ■ 3 

F FOR AN»LYSH or VAPUncE ON R • 1.082 
etTi «EI0HT5 

3,436 -a.0fl7 5.971 

CONTRiq'jTlOKS TO ^-ULTIPLe CORPELATIOn 

ANO ©EORESSION FACTOR LOaoINGSi 2N0 COLU*'NI 
3 < 0.6?9 0.63^ 

? SQUAP -1.529 0.584 

1 Jt CW 0.974 0.560 

souareo beta weights 

11.^07 80.7A8 35.655 
« WFT0MT5 

39.356 •84.877 48.463 
INTfPcEPT CONSTANT ■ 2.9fl| 



ANCVA TABLE FOR POLVNCMfALS 



ERIC 



RCmjCTJON OtiF TO LINEIR ffT. WITH 1 Of • O.O35 

Rf^lOUAL S.$. • 0,955 OF ■ 37 PESIOUaL M.s, p ii.ij2a 

F FOR LINfiP fir m 1,12? - ' ^ ' 

RCnUCTION OIJF TO OCnEPal OUAORATIC fit with OF 2# • 0 OJS 

RFOUCTION M.^. . 0,018 

oFcIOIJAL . 0,965 or • 36 PEsiOUAL M,s, • 0tft2T 

F FOR OuAOR4TtC FIT ■ D.656 v .3. . {j.n£7 

prOllCTION OUF TO CUAHBITIC TFPM ALCnE, WITH 1 cr» • o.OOl 

F FCR OdlORATrC TERM ALOnC ■ 0.020* v.wi , 

PrOliCTlnN OUf to flCNFR*L CUBIC FIT M|TH OF 3, « n 085 

REoiiCTiON M,^, m coie 

RfSlDUAL 5.<l, • 0.R15 Of • 35 PEstOUAL M.S. • 0.026 1*33 

Q FOR OrNCflai. CtlRIC FIT • 1.082 

- -'"owcrroN niJF TO cupic term no^i with i of ■ , o.oso 

FOP CnPIC TrPM ALONE ■ I.9n3 



TM RATING 

TmC PRCOTCTOR VARItnLEJX) IS WHE, *ffO THE CBITirfllON VAPtHflLE(y| IS Tp 3C0Rt, 



TrST MEANS 


*Nn ^TAKHARC 


DEVIATIONS 






1 X 


fl,496 


0.19* 






7 $OUAR. 










3 X CURE 


s,?e2 








4 Y 








COPRELATtON 


MATRIX 








) t 


Uooo 


0.978 


0.93fl 




? $auAR 


Q .QTfl 


1 .000 


0.9fl* 


<1*«19 


K CU8€ 






I .000 


0»A0? 


* V 




0i4]9 







FTflST, SPCONO, AND THIPO neCiREE pyLYNOH I aUS , 



MLtttPUC P II 0,403 
N.n.F.l ■ j 

w.o.r,? - 37 

r rpR AN^^LYSr^ VARMNCE ON R ■ 7,172 
BFTi WtinHTS 
0.*^>3 

CO^'TRIRUTIrtN^ TO M'ULTfPLE COpRCLAriOW 

*N0 REORE^^ION rfccTCR lCaoINGSi 2N0 COUUrN) 

1 X 0,162 1,000 

S':u«r€o seta wfroi-rs 

R WftflMTS 

Jt-TERCEPT CONSTANT ■ 3«?3A 

MLi.TIPLE « SOiiARC ■ O.UT 
MKLtlPLC R . o,4?i 
N,0,F,1 ■ 7 
N.O.F,? ■ 31^ 

r roR ANALYSTS Of VarMNCE On R ■ 3.867 
WEIGHTS 

6.S76 

CONTRIRUTTONS TO KULTlPtt CORREHTIOn 

i^'O REORif^^lON Fac^'CH LCaoINGSi 2N0 COLUMN) 
1 X •0,OeS 0.9&8 

? SOUAR 0,2A? 0,997 

SQUARED RETA ^TIOHTS 

0.026 hn'iyz 

ft wrrOHTS 

-l.AAA 9. 018 
INTERCEPT CONSTANT ■ 

MULTIPLE R SO'URE « 0.^24 " **' 

MULTIPLE R . 0,473 
N»0,F»i ■ J 
N,0,F,p • 39 

F FOR ANALYSIS OF VARIANCE ON R ■ 3*362 
BFTA WEIGHTS 
-3.771 8,7r8 -Atde? 

C0NTRIRUT7ONS TO MULTIPLE CORR£LATlON 

AND RFORCSciON FacTCR LOaoINGS» 2N0 C0LU*'N) 
I X -1 .520 o.aJ>2 

? SOUAR '»,d?0 0.886 

^ X CU8F •1,907 0.864 

scuareo beta wrroHTs 

n.??? TS,«>3 2U785 
B WFIOHTS 

INTERCEPT CONSTANT ■ 9.0IT 



1^ 



ANOVA TARLE rcR POLYNCNfA 

«FftUCTlON Diir rn LlwEAR FiTt WITH 1 OF ■ 0.162 

<'€"<JfOUAL S,S, - 0,*3« OF • 37 RESIDUAL M,5, ■ 0.023 

F FOR LINEAR PIT ■ 7,1^2 

ofnUCTION OUF TO GENERAL CUaORATIC rlT «lTH OF 2% m 0.J77 
RfOuCTION M,S, ■ 0,08» 
OFSTOIJAL S,s. ^ P,P23 OF ■ 36 RESIDUAL M.S. ■ 0*023 

r Fop ouadrattc ;fit k i,fl#,7 

PFOficrroN nuF ro cuAoRiTfr Team alcne» wcTk 1 o^i • O.ou 

f ^OR OlfAORATTC TERM ALOnE ■ 0,63* 



ERIC 



RfOnCTlON niiF Trt OEnER^L CUBIC riT WITH OF 3, . 0.224 
RfOUCTtON M,S, m 0.075 
BfSIOUAL . 0.776 or • 3» RESIDUAL M.$, ■ 0t022 1-34 

O CR OE.NERAL Cn«lC FIT a 3.362 

"UCTION niiF TO CURTC TtR^* ALONE WITH 1 OF ■ 1 0.04? 
OR CURIC TrRM ALONE ■ 2.113 



APPENDIX J 



JOB TASK CONDITIONAL AND 
JOINT FREQUENCIES BY RATING 



J-1 



THIS PAGE IS BLANK 



TASK CONDITIONAL AND 
JOINT f^REQlJENCIES BY RATING 



This Appendix wi Vi be devoted to presenting the Job Task Conditional 
and Joint Frequency Matrices by rating for the data collected on the 
Technical Proficiency Checkout Form (TPCF), The matrices are synetric 
about their nain diagonal and therefore only the upper triangular portion 

will be presented. Denote an arbitrary entry in the i^*^ row and j^^ 
column (i=l, '..58) as a. read left to right and top to bottom for 

rows and columns respectively. 

For the Job Task Conditional Frequency Matrices, the entries on the 
main diagonal, a^ . (i=l, ...,8), are the number of technicians CHECKED 

OUT on the (9-i)th job task, but NOT CHECKED OUT on an any inore difficult 
task. The entry off the main diagonal, a. . (i = l, 8; j -i) is the 

number of technicians CHECKED OUT on the (9-j)^^ task given they are 

CHECKZD OUT at most on the (9-i) task. For example, from page J-4, there 
were 17 EM's who were CHECKED OUT at v^ost on Job Task No. 7, i.e.. they 
were NOT CHECKED OUT on Job Task No. 8. Of those 17 men a, 13, 1^, 17, 
17, and 17 were CHECKED OUT on Job Task No.'s 6, 5, 4, 3, 2, and 1 res, 
pectively. 

In the Job Task Joint Frequency Matrices, the entries on the main 
.diagonal, a- ^ {i=^ , ..^^ 8), are the number of individuals CHECKED OUT 

on the i task, regardless of their performance on any of the other tasks. 
The entries off the main diagonal, a. . (i=i, 8: j>i), are the number 

»J th th 

of technicians CHECKED OUT on both the i and j job task. For example, 
from page J-4, 75 EM's were CHECKED OUT on Job- Task ^lO. 5, 42 on Job Tasks 
No. *s 5 and 6, etc. 



J--3 

ERIC 



I 



FLECTRI CLAN'S MATE (EM) RATING 
(N = 97) 



Conditional Frequencies 
Job TasI: 

« 7 6 5 * , 3 2 1 

S-^ if^ 33 50 50 SO 52 55 

17 ^ 13 U 17 17 17 

6 6 5 5 4 6 

6 5 ' 6 6 6 

3 3 3 3 

6 5 6 

0 0 
2 



The number of technicians not CHECKED OUT on any job task is 2 



Joint Frequencies 

* 

Job Task 

I ? 3 4 5*6 7 8 

9S H7 87 77 75 43 63 55 

b4 73 70 40 63 52 

H7 71 69 40 62 50 

77 6<^ 40 56 50 

.75 4? 56 50 

43 35 33 

63 46 



55 



13? 



^ ELECTRONICS TECHNICIAN f£T) RATING 
(N = 173) 



Conditional Frequencies 







Job 


Task 








7 




5 




3 


c 


I 


114 


PI 


113 


131 


127 


123 


1 ji 


IS 




6 


15 


15 


11 


IS 




ifi 


S 


6 


in 


7 


9 






2 


2 


? 


1 


2 








Q 


fi 


4 












? 


I 


I 












0 


0 


\ 












2 


number of 


technicians not 


CHECKED 


OUT on 


any job task 


is 1 



Joint Frequenci^^s 



Job Task 

1 2 3 4 5 A 7 8 

" l4*^ 1^0 163 126 129 131 

147 14^ 143 117 lie 123 

164 159 124 95 ' 124 127 

/ 16S 125 94 " 12g 131 

126 88 108 113 

9fr 83 81 

129 114 
132 



ERLC 



FIRE CONTROL TECHNICIAN (FT) RATING 
- (N = 154) 



Conditional Frequencies 
Job Task 

*^ 7 ft» 5 3 2 1 

10? 9? 74 Bf» 101 V4 90 102 

H S 6 B « 8 . P 

14 O 12 14 12 14 

is 14 12 10 14 

« 4 4 7 

2 1 2 

0 0 
1 

The number of technicians not CHECKED OUT on any job task is 4 



Joint Frequencies 
Job Task 

4 b 



134 Q3 jQQ 

1^5 i?i 101 H6 94 go 

13<» 12A 106 91 96 94 

143 114 QO 99 101 

116 76 86 86 

93 76 74 

100 92 
102 



ERIC 



J-6 



INTERIOR COMMUNICATIONS ELECTRICIAN (IC) RATING 

(N = 58) 





Condi tional 


Frequencies 










Job 


Task 








6 


5 




3 


2 


I 


20 


?3 


27 


26 


26 


27 


I 


6 


s 


6 


6 


6 


5 


4 


2 




4 


5 




a 


7 


6 


4 








3 


3 


2 


3 








4 


3 


4 










0 


0 



4 

The number of technicians not CHECKED OUT on any job task is 1 



2 




Joint Frequencies 
Job Task 



57 4S ^ 49 44 41 26 33 27 

4S 4^ 38 36 ?S 32 26 

4 1 38 2S 32 26 

44 37 ?3 32 27 

41 2S 29 23 

?^ 21 >0 

33 27 
?7 



J-7 



RADARMAN (RD) RATING 
(N = 139) 



Conditional Frequencies 

^ Job Task' 

H 7 6 S 4 3 2 1 

?(s 7 ^» 2S 14 4 5 26 

- 1 1 1 1 ' I 1 ^1 

1 1 1 0 0 1 

70 31 30 16 70 

3 2 2 3 

1 1 1 

2 2 
32 

The number of technicians not CHECKED OUT on any job task is 3 



1 



Joint Fre'qiiencies 
Job Task 



5 



I3h 27 38 e>0 

cl 23 le 



97 8 

21 3 I 5 



VAC 



'St 33 34 • ? 2 4 

SO 47 7i 6 . 14 

I 

97 B 8 ?5 

B 3 6^ 

8 7 

* * 26 



J<8 



13 



RADIOMAN (RM) RATING 
(N = 137) 







Condi ti onal 


Frequencies 












Job 


Task 








7 


6 


5 




3 


2 


1 






13 


13 


13 


12 


13 






17 


17 


\\ 


11 


17 






2M 


22 


28 


24 


29 






55 


32 


4n 


34 


55 








4 


3 
5 


3 
*k 

0 


4 

5 
0 
12 



The number of technicians not CHECKED OUT on any job task is 2 
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Joint Frfequencies 
Job Task 



5 7 8 

113 <»6 27 13 



. t9 81 3. 20 12 

luO 76 • ^1 ^ 21 

qR ft? 39 27 13 

\ ri 3 
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4S 27 13 

4f. 17 9 

27 1« 
13 



^' SONAR TECHNICIAN (ST) RATING 
(N = 152) 



Conditional Frequencies 
Job Task 

ft 7 6-^5 4 3 2 1 

80 74 8<? 78 77 77 HO 

13 ' 11 ^ 12 13 13 13 

. 18 16 10 1"^ 14 18 

, . 27 15 10 IP 24 

2 1 12 

3 3 3 

0 0 

4 



The number of technicians not CHECKED OUT on any job task is 5 



Joint Frequencies 
Job Task 

^ 2 3 4 5 6 7 8 

11« . 119 lis 118 103 77 HO 

n« llH 10? 98 76 77 

11*> 102 100 99 76 -77 

117 101 94 76 "^78 

* 121 92 69 69 

103 75 74 

77 64 
*^0 
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TORPEDOMAN'S MATE (TM) RATING 
(N.= 39) 



Condi tional Frequencies 



Job Task 

7 6 S 4 3 2 I 

^ 8 8 8 8 8 

I? 5 12 11 12 12 12 

3 3 3 3 3 3 

11 4 6 6 10 

3 2 5 

0 0 ^ 0 

0 0 
0 



The number of technicians not CHECKED OUT on ^riy job task is 0 



Joint Frequencies 



Job Task 

1 ? 3 4 5 6 7 B 

3M 30 31 31 33 14 18 8 ' 

31 31 27 2<? 14 is 8 

3? 2fl 29 14 18 8 

31 26 14 17 8 

34 14 ' 18 8 

14 10 6 

18 6 
8 



ERLC 



j-n 



THIS PAGE IS BLANK 



J-12 



ERIC 



ERIC 



APPENDIX K 
THE UTILITY OF THE WRE 
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THE UTILITY OF THE WRE 



The purpose of this section is to demonstrate the utility of the WRE 
as .an estimator of individual performance. Essentially it is a useful type 
of estimator in that it is not dependent on a convention to be adopted for 
the case wherein a man did not work at particular job activity. As such 
the convention need only provide reliability ratios for those job activities 
for which the man being evaluated received IDE = 0 and ZUI = 0 from his 
supervisor. * 

Each square in Table 1 represents a breakdov;n of Table E-1 into the 
number (and oroportion) of men who did not work at a particular job acti- 
vity and those men who received IDE = 0 and lUI - 0, For example, on job 
activity Number 1, 19 {]9.6% of the EfVs) received ZUE = 0 and LUI = 0 
and 5 (6.2/^ of the EM's) did not work at that job activity. The composite 
reliability values need then only be employed on 19,6% of the men in that 
rating and job activity rather then on 25% of the men as required by the 
SRE, PRE, and GRE, More significantly, in the case of RD's and RM's, for 
example, at most 59% (as compared to 99r. for the SRE, PRE, and GRE) of the 
men in those ratings derive reliability ratios for some job activities 
from the composite reliability table. Clearly this is a significant im- 
provement which should improve individual performance estimates. The 
statistical analyses reported in the main text of this oaoer verified this 
conjecture. 



Derivation of the Weights Employed by the WRE 

On the JPQ ANSWER SHEET is Appendix A, page A-4, in column (c) for 
each job activity the following question was answered by the supervisor 
on the man he was evaluating: 

QUESTION (c) Considering this ma'' 'o ;.v'jra] 1 performance, it is your 
opinion that the in;portance of this job activity, as a 
factor in determining the overall oerformance of this man, 
is best described as being: 
3. of central and primary importance 
2. a significant factor, but of secondary importance 
1, of only moderate importance in estimating overall 

performance 
0. of littlt or no importance 

The weights (w^) for the i^*^ job activity are determined by the foYHiula: 

If the supervisor recorded the i^*^ job activity as: 

of central and primary importance, the weight w^ = !,0 

of secondary importance, the weight w^- = .75 

of moderate importance, the weight w^- = ,5 

of little or no importance, the weight w^- = .25. 
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TABLE K-1 

tlUMBER AriD PROPORTIOri OF TECHNICIANS IN EACH PROBLEM AREA 



Job 
Act. 



2 
3 
4 
5 
6 
7 
8 



EM 
N7 'iW 



ET 

■iZ m 



FT 



Rating 

IC RD RM ST TM 

•jZ 'IW U2 NW NZ NW NZ NW ' NZ NW 



1? 6 
:,196 0,062 


3B 0 

0.220 a.ooe 


91 9 
O.S^Il 0,032 


9 0 
0,159 O.OOft 


46 4 

C.331 0,029 


34 19 
0.248 0.139 


39 6 
G,297 0.039 


1 

6 

0,194 O.ftOO 


16 7 
0,169 0,072 


47 0 

0,272 o.oon 


46 1 

0.312 0,006 


7 0 
0,121 0.00ft 


52 I 
0,3>4 0.007 


27 . 19 
0.197 0.109 


36 9 
0,237 0,099 


13 0 
0.333 M.flOO 


0,2^9 0,144 


42 S 
0.243 0,017 


70 9 
0,499 0,032 


17 I 
0;293 0.017 


»1 62 
C,9.'^l 0.446 


47 57 
0.343 0,416 


93 16 
0,349 C,1C9 


20 e 
0,913 0.194 


2« 14 
g,299 0,144 


93 30 
0.306 0,173 


67 26 
0««39 e.l69 


22 9 
0,379 0«Oe6 


99 29 
P. 360 0 .180 


39 38 
0.289 0.277 


97 19 
0,379 0,129 


6 2 
0,209 0.n91 


16 9 
0,166 0,092 


62 1 
C,474 0.006 


7f 1 

0,913 0,006 


7 0 
0.121 O.OOft 


3.91^ 0.Q36 


39 11 
0.219 fl.08n 


58 4 

0,382 Of02e 


10 1 
0,296 0.026 


0,392 0,124 


63 33 
0.4B0 0,191 


79 36 
0,913 0,234 


24 11 
0.414 0«190 


99 41 

9.424 0.299 


42 4fr 

O.Sr'" 0.336 


> 58 32 
0,3^2 0,211 


19 9 
0,369 0.126 


13 9 
^.134 0,092 


47 1 

0.272 0,006 


69 14 
0,440 0,091 


9 0 
0,006 fi.OOn 


90 87 
ft. 367 0.626 


94 74 
0,394 0.940 


49 27 

0,322 o.t--:^ 


23 2 
n,990 O.nbl 


22 13 
C,227 0,134 


4« 0 

0.277 O.COO 


60 4 

0,390 0,0:^6 


12 0 
0:?£)7 O.OOP 


91 fll 
0.^67 0,983 


90 64 
0,369 ft, 467 


49 16 

- 0,296 0,109 


16 4 
0*442 0.503 



Mumber of 
97 



Men Each Rating 
173 154 



5H 



139 



137 



152 



39 



NZ = Number and Proportion of Technicians Who Received, ::UE=0 and ZUI=0 

NW = Number and Proncrtion of Technicians Who Did Not Work at that Job Activity 
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rt?5-ults C'f the ^^tatistici:! 'inalysir indi:?Hted that a certain comhination of 
the per ^ onr.anrre data poasesged moderate validity for appraising the absolute level 
of techniciaj: on-t he-Jot performance in the r?-l, 57?, FT, and IC ratings. Applicfiticn 
r;:" th'jr technique- to ttJhr.icians in th** P.M> ''T, a.nd ratioKs vas tenuous, but Ltll] 
ai pr opr; ate , vhilo none of the performance •'•stimfttorc 3ee~.cd to be apr lioable tu 
t -vOhnicians ir. the RD rating. For this reaso.'^ it would seem that the approfr: at '?n','r*^ 
of application of this technique tc other ratinj^s varrants : rivestipiat i or. , r.erhfips by 
^ippr* ^ich er.p oyed in t:ii;s report. In any ev^.^it 'lt has tt^en otscrvei that the 
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